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Preface 


It has long been the established policy of CRC Press to publish, in handbook form, 
the most up-to-date, authoritative, logically arranged, and readily usable reference 
material available. Prior to the preparation of this 31“ Edition of the CRC Standard 
Mathematical Tables and Formulae, the content of such a book was reconsidered. 
The previous edition was carefully analyzed, and input was obtained from practi- 
tioners in the many branches of mathematics, engineering, and the physical sciences. 
The consensus was that numerous small additions were required in several sections, 
and several new areas needed to be added. 

Some of the new materials included in this edition are: game theory and voting 
power, heuristic search techniques, quadratic elds, reliability, risk analysis and de- 
cision rules, a table of solutions to Pell’s equation, a table of irreducible polynomials 
in [т], a longer table of prime numbers, an interpretation of powers of 10, a col- 
lection of “proofs without words”, and representations of groups of small order. In 
total, there are more than 30 completely new sections, more than 50 new and mod- 
ied entries in the sections, more than 90 distinguished examples, and more than a 
dozen new tables and gures. This brings the total number of sections, sub-sections, 
and sub-sub-sections to more than 1,000. Within those sections are now more than 
3,000 separate items (a de nition , a fact, a table, or a property). The index has also 
been extensively re-worked and expanded to make nding results faster and easier; 
there are now more than 6,500 index references (with 75 cross-references of terms) 
and more than 750 notation references. 

The same successful format which has characterized earlier editions of the Hand- 
book is retained, while its presentation has been updated and made more consistent 
from page to page. Material is presented in a multi-sectional format, with each sec- 
tion containing a valuable collection of fundamental reference material—tabular and 
expository. 

In line with the established policy of CRC Press, the Handbook will be kept as 
current and timely as is possible. Revisions and anticipated uses of newer materials 
and tables will be introduced as the need arises. Suggestions for the inclusion of new 
material in subsequent editions and comments regarding the present edition are wel- 
comed. The home page for this book, which will include errata, will be maintained 


at http://www.mathtable.com/. 
The major material in this new edition is as follows: 


Chapter 1: Analysis begins with numbers and then combines them into series and 
products. Series lead naturally into Fourier series. Numbers also lead to func- 
tions which results in coverage of real analysis, complex analysis, and gener- 
alized functions. 


Chapter 2: Algebra covers the different types of algebra studied: elementary al- 
gebra, vector algebra, linear algebra, and abstract algebra. Also included are 
details on polynomials and a separate section on number theory. This chapter 
includes many new tables. 


Chapter 3: Discrete Mathematics covers traditional discrete topics such as combi- 
natorics, graph theory, coding theory and information theory, operations re- 
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search, and game theory. Also included in this chapter are logic, set Шеогу, 
and chaos. 


Chapter 4: Geometry covers all aspects of geometry: points, lines, planes, sur- 
faces, polyhedra, coordinate systems, and differential geometry. 


Chapter 5: Continuous Mathematics covers calculus material: differentiation, in- 
tegration, differential and integral equations, and tensor analysis. A large table 
of integrals is included. This chapter also includes differential forms and or- 
thogonal coordinate systems. 


Chapter 6: Special Functions contains a sequence of functions starting with the 
trigonometric, exponential, and hyperbolic functions, and leading to many of 
the common functions encountered in applications: orthogonal polynomials, 
gamma and beta functions, hypergeometric functions, Bessel and elliptic func- 
tions, and several others. This chapter also contains sections on Fourier and 
Laplace transforms, and includes tables of these transforms. 


Chapter 7: Probability and Statistics begins with basic probability information (de n - 
ing several common distributions) and leads to common statistical needs (point 
estimates, con d ence intervals, hypothesis testing, and ANOVA). Tables of the 
normal distribution, and other distributions, are included. Also included in this 
chapter are queuing theory, Markov chains, and random number generation. 


Chapter 8: Scientific Computing explores numerical solutions of linear and non- 
linear algebraic systems, numerical algorithms for linear algebra, and how to 
numerically solve ordinary and partial differential equations. 


Chapter 9: Financial Analysis contains the formulae needed to determine the re- 
turn on an investment and how to determine an annuity (1.е., the cost of a 
mortgage). Numerical tables covering common values are included. 


Chapter 10: Miscellaneous contains details on physical units (de nition s and con- 
versions), formulae for date computations, lists of mathematical and electronic 
resources, and biographies of famous mathematicians. 


It has been exciting updating this edition and making it as useful as possible. 
But it would not have been possible without the loving support of my family, Janet 
Taylor and Kent Taylor Zwillinger. 


Daniel Zwillinger 


zwillinger@alum.mit.edu 


15 October 2002 
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1.1 CONSTANTS 


1.1.1 TYPES OF NUMBERS 


1.1.1.1 Natural numbers 


The set of natural numbers, {0,1,2,...}, is customarily denoted by М. Many authors 
do not consider 0 to be a natural number. 


1.1.1.2 Integers 


The set of integers, {0,+1,+2,...}, is customarily denoted by Z. The positive 
integers are {1,2,3,...}. 


1.1.1.3 Rational numbers 
The set of rational numbers, 15 | p,q € Z,q # 0}, is customarily denoted by Q. 
Two fractions Б and = are equal if and only if ps = gr. 


Addition of fractions is de ned by E +2 = e Multiplication of fractions 
т — pr 


is de ned Бу?-2- 


8 gs" 


1.1.1.4 Real numbers 


The set of real numbers is customarily denoted by R. Real numbers are de ned to 
be converging sequences of rational numbers or as decimals that might or might not 
repeat. 

Real numbers are often divided into two subsets. One subset, the algebraic 
numbers, are real numbers which solve a polynomial equation in one variable with 
integer coef cien ts. For example; a is an algebraic number because it solves the 


polynomial equation 222 — 1 = 0; and all rational numbers are algebraic. Real num- 
bers that are not algebraic numbers are called transcendental numbers. Examples of 
transcendental numbers include z and e. 


1.1.1.5 Complex numbers 


The set of complex numbers is customarily denoted by C. They are numbers of the 
form a + bi, where i? = —1, and a and b are real numbers. See page 53. 


Operation computation result 

addition (a+bi)+(c+di) (a+c) + i(b + d) 

multiplication (a + bi)(c + di) (ac — bd) + (ad + bc)i 
1 b 


a 
a + bi rU rw 
complex conjugate z — a + bi z2a— bi 


reciprocal 


Properties include: z + w = Z + W and zw = Z v. 
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1.1.2 ROMAN NUMERALS 


The major symbols in Roman numerals are I = 1, V = 5, X = 10, L — 50, С = 100, 
D — 500, and M — 1,000. The rules for constructing Roman numerals are: 


1. A symbol following one of egual or greater value adds its value. (For example, 
II = 2, XI = 11, and DV = 505.) 


2. A symbol following one of lesser value has the lesser value subtracted from 
the larger value. An I is only allowed to precede a V or an X, an X 1s only 
allowed to precede an L or a C, and a C is only allowed to precede a D or 
an M. (For example IV — 4, [X — 9, and XL — 40.) 


3. When a symbol stands between two of greater value, its value is subtracted 
from the second and the result is added to the rst (for example, XIV— 10 + 
(5 — 1) = 14, CIX= 100 + (10 — 1) = 109, DXL= 500 + (50 — 10) = 540). 


4. When two ways exist for representing a number, the one in which the symbol 
of larger value occurs earlier in the string is preferred. (For example, 14 is 
represented as XIV, not as VIX.) 


Decimal number 1 2 3 4 5 6 7 8 9 
Roman numeral I II Ш IV V VI УП УШ IX 


10 14 50 200 400 500 600 999 1000 
X XIV L CC CD D DC CMXCIX M 


1950 1960 1970 1980 1990 
MCML MCMLX MCMLXX MCMLXXX MCMXC 


1995 1999 2000 2001 2004 2010 
MCMXCV MCMXCIX MM MMI MMIV MMX 


1.1.3 ARROW NOTATION 


Arrow notation is a way to represent large numbers in which evaluation proceeds 
from the right: 


mÎn=m m -m 
—Á— 
n 


Са qon, [eue (1.1.1) 


тп тт thm 


n 


For example, m T п = m”, m TT 2 = m", and m tt 3 = mo), 
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1.1.4 REPRESENTATION OF NUMBERS 


Numerals as usually written have radix or base 10, so that the numeral a „dn —1 . . - A149 
represents the number a,10” + an—110"~! +... + a210? + a110 + ag. However, 
other bases can be used, particularly bases 2, 8, and 16. When a number is written in 
base 2, the number is said to be in binary notation. The names of other bases are: 


2 binary 9 nonary 

3 ternary 10 decimal 

4 quaternary 11 undenary 

5 guinary 12  duodecimal 
6 senary 16 hexadecimal 
7 septenary 20  vigesimal 

8 octal 60  sexagesimal 


When writing a number in base b, the digits used range from 0 to b — 1. If 
b > 10, then the digit A stands for 10, B for 11, etc. When a base other than 10 is 
used, it is indicated by a subscript: 


101115 = 1 x 2+0 x 2? +1x2? +1x2+1= 23, 
A316 = 10 x 16 + 3 = 163, (1.1.2) 
5437 2 5x D +4 x 7+3 = 276. 


To convert a number from base 10 to base b, divide the number by b, and the 
remainder will be the last digit. Then divide the quotient by b, using the remainder 
as the previous digit. Continue dividing the quotient by b until a quotient of 0 is 
arrived at. 


EXAMPLE То convert 573 to base 12, divide 573 by 12, yielding a quotient of 47 and a 
remainder of 9; hence, “9” is the last digit. Divide 47 by 12, yielding a quotient of 3 and 
a remainder of 11 (which we represent with a “B”). Divide 3 by 12 yielding a quotient 
of 0 and a remainder of 3. Therefore, 57319 = 3B91». 


In general, to convert from base b to base r, it is simplest to convert to base 10 
as an intermediate step. However, it is simple to convert from base b to base b”. For 
example, to convert 110111101» to base 16, group the digits in fours (because 16 
is 2^), yielding 1 1011 11015, and then convert each group of 4 to base 16 directly, 
yielding 1BD1g. 
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1.1.5 BINARY PREFIXES 
A byte is 8 bits. A kibibyte is 219 = 1024 bytes. Other pre x es for power of 2 are: 


Factor Prex Symbol 


1.1.6 DECIMAL MULTIPLES AND PREFIXES 


The pre x names and symbols below are taken from Conference Générale des Poids 
et Mesures, 1991. The common names are for the U.S. 


Symbol 


1000799) 
10100 
1024 
1021 
1018 
1015 
1012 
10° 
10% 
10? 
107 
10! 
107! 
107? 
107? 
1076 
10-9 
10-1? 
10-15 
10-18 
10-21 
10-24 
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egmnmm"zaod'tuN-d 


(Greek mu) 


с 
m 
H 
n 
р 
f 
a 
2 
М 


googolplex 
googol 
heptillion 
hexillion 
quintillion 
quadrillion 
trillion 
billion 
million 
thousand 
hundred 
ten 

tenth 
hundreth 
thousandth 
millionth 
billionth 
trillionth 
quadrillionth 
quintillionth 
hexillionth 
heptillionth 


1.1.7 DECIMAL EQUIVALENTS OF COMMON FRACTIONS 


0.015625 0.515625 
0.03125 0.53125 
0.046875 0.546875 
0.0625 0.5625 
0.078125 0.578125 
0.09375 0.59375 
0.109375 0.609375 
0.125 0.625 
0.140625 0.640625 
0.15625 0.65625 
0.171875 0.671875 
0.1875 0.6875 
0.203125 0.703125 
0.21875 0.71875 
0.234375 0.734375 
0.25 0.75 
0.265625 0.765625 
0.28125 0.78125 
0.296875 0.796875 
0.3125 0.8125 
0.328125 0.828125 
0.34375 0.84375 
0.359375 0.859375 
0.375 0.875 
0.390625 0.890625 
0.40625 0.90625 
0.421875 0.921875 
0.4375 0.9375 
0.453125 0.953125 
0.46875 0.96875 
0.484375 0.984375 
0.5 1 
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1.1.8 HEXADECIMAL ADDITION AND SUBTRACTION TABLE 


А = 10, B = 11,C = 12, D = 13, E = IA, F = 15. 
Example: 6 + 2 = 8; hence 8 — 6 = 2 and 8 — 2 — 6. 
Example: 4 4- E — 12; hence 12 — 4 — E and 12 — E — 4. 


ШИВ 2 3 4 5 6 7 8 9 А В С Р Е Е 
[1 [02 03 04 05 06 07 08 09 OA ОВ OC OD OE OF 10 
[2 [03 04 05 06 07 08 09 OA OB OC OD OE OF 10 11 


(3 |04 05 06 07 08 09 OA OB OC OD OE OF 1 


0 11 12 
[4 |05 06 07 08 09 ОА 08 ОС OD OE OF 10 11 12 13 
12 13 14 


|5 [06 07 08 09 0A ОВ 0С OD OE OF 10 11 


[6 [07 08 09 0A 0B 0C 0D ОЕ OF 10 1| 12 13 14 15 | 
|7 |08 09 0A OB OC OD ОЕ ОЕ 10 11 12 13 14 15 16 
[5 |09 0A 0B 0C 0D 0E OF 10 1| 12 13 14 15 16 17] 
79 [0A 0B 0c 0D 0E OF 10 1| 12 13 i4 15 16 17 18] 
FA 


A [OB OC OD OE OF 10 11 12 13 14 15 16 17 18 19 
[S [0C 0D 0E 06 10 1| 12 13 14 15 16 17 18 19 TA] 
OD OE OF 10 11 12 13 14 15 16 17 18 19 1A IB 
р | OE OF 10 ІІ 12 13 14 15 16 17 18 19 1A ІВ ІС 
OF 10 11 12 13 14 15 16 17 18 19 1A 1B ІС ID 
10 11 12 13 14 15 16 17 18 19 1A IB 1С ID IE 


1.1.9 HEXADECIMAL MULTIPLICATION TABLE 


Example: 2 x 4 — 8. 
Example: 2 x F = 1E. 


18 1B IE 21 


IC 23 2A 31 38 3F 46 4D 54 5B 62 609 


10 18 20 28 30 38 40 48 50 58 60 68 70 78 


12 1B 24 Ж 36 ЗЕ 48 51 SA 63 6C 75 ЛЕ 87 
OA 14 1E 28 32 3C 46 50 SA 64 6E 78 82 8С 96 


F 


ГЕ [OF IE 2D ЗС 4B 5A 69 78 87 96 AS B4 СЗ D2 El 
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1.1.10 HEXADECIMAL-DECIMAL FRACTION CONVERSION 


TABLE 


The values below are correct to all digits shown. 


0 3 0.250000 | . 0.500000 | . 0.750000 
0.003906 0.253906 | . 0.503906 | . 0.753906 
0.007812 | . 0.257812 | . 0.507812 |. 0.757812 
0.011718 | . 0.261718 |. 0.511718 |. 0.761718 
0.015625 | . 0.265625 |. 0.515625 |. 0.765625 
0.019531 |. 0.269531 |. 0.519531 |. 0.769531 
0.023437 |. 0.273437 |. 0.523437 | . 0.773437 
0.027343 |. 0.277343 |. 0.527343 | . 0.777343 
0.031250 0.281250 |. 0.531250 | . 0.781250 
0.035156 | . 0.285156 | . 0.535156 |. 0.785156 
0.039062 | . 0.289062 | . 0.539062 | . 0.789062 
0.042968 | . 0.292968 | . 0.542968 | . 0.792968 
0.046875 | . 0.296875 | . 0.546875 | . 0.796875 
0.050781 | . 0.300781 | . 0.550781 | . 0.800781 
0.054687 | . 0.304687 | . 0.554687 | . 0.804687 
0.058593 | . 0.308593 | . 0.558593 | . 0.808593 


0.062500 0.312500 | . 0.562500 | . 0.812500 
0.066406 0.316406 | . 0.566406 |. 0.816406 
0.070312 0.320312 |. 0.570312 |. 0.820312 
0.074218 0.324218 |. 0.574218 |. 0.824218 
0.078125 0.328125 |. 0.578125 |. 0.828125 
0.082031 0.332031 | . 0.582031 |. 0.832031 
0.085937 0.335937 | . 0.585937 |. 0.835937 
0.089843 0.339843 | . 0.589843 |. 0.839843 
0.093750 0.343750 |. 0.593750 |. 0.843750 
0.097656 0.347656 | . 0.597656 |. 0.847656 
0.101562 0.351562 | . 0.601562 |. 0.851562 
0.105468 | . 0.355468 | . 0.605468 |. 0.855468 
0.109375 0.359375 | . 0.609375 |. 0.859375 
0.113281 0.363281 | . 0.613281 | . 0.863281 
0.117187 |. 0.367187 | . 0.617187 | . 0.867187 
0.121093 0.371093 | . 0.621093 | . 0.871093 


0.125000 | . 0.375000 |. 0.625000 | . 0.875000 
0.128906 0.378906 | . 0.628906 | . 0.878906 
0.132812 |. 0.382812 |. 0.632812 |. 0.882812 
0.136718 |. 0.386718 |. 0.636718 |. 0.886718 
0.140625 | . 0.390625 | . 0.640625 | . 0.890625 
0.144531 0.394531 | . 0.644531 |. 0.894531 
0.148437 | . 0.398437 | . 0.648437 | . 0.898437 
0.152343 | . 0.402343 | . 0.652343 |. 0.902343 


© 2003 by СКС Press LLC 


28 0.156250 | .68 0.406250 |. 0.656250 | ЕВ 0.906250 
29 0.160156 | .69 0.410156 |. 0.660156 | .E9 0.910156 
2А 0.164062 | 6A 0.414062 |. 0.664062 | ВА 0.914062 
28 0.167968 | .6B 0.417968 |. 0.667968 | .EB 0.917968 
2С 0.171875 | .6C 0.421875 |. 0.671875 | EC 0.921875 
20 0.175781 | .6D 0.425781 |. 0.675781 | .ED 0.925781 
.2E 0.179687 | .6E 0.429687 |. 0.679687 | .EE 0.929687 
.2F 0.183593 | .6F 0.433593 |. 0.683593 | ЕЕ 0.933593 


130 0.187500 | .70 0.437500 |. 0.687500 | ЁО 0.937500 
.31 0.191406 0.441406 | . 0.691406 | .F1 0.941406 
32 0.195312 | 72 0.445312 |. 0.695312 | .F2 0.945312 


133 0.199218 | .73 0.449218 |. 0.699218 | .F3 0.949218 
34 0.203125 | 74 0.453125 |. 0.703125 | .F4 0.953125 
135 0.207031 | 75 0.457031 |. 0.707031 | .F5 0.957031 
.36 0.210937 | 76 0.460937 |. 0.710937 | .F6 0.960937 
137 0.214843 | .77 0.464843 |. 0.714843 | .F7 0.964843 
138 0.218750 | 78 | 0.468750 |. 0.718750 | . 0.968750 
39 0.222656 | 79 0.472656 |. 0.722656 | .F9 0.972656 
ЗА 0.226562 | ЛА 0.476562 |. 0.726562 | . 0.976562 
3В 0.230468 | .7B 0.480468 |. 0.730468 | . 0.980468 
3C 0.234375 | .7C 0.484375 |. 0.734375 | . 0.984375 
.3D 0.238281 | .7D 0.488281 |. 0.738281 | . 0.988281 
ЗЕ 0.242187 | ЛЕ 0.492187 |. 0.742187 |. 0.992187 
ЗЕ 0.246093 | ЛЕ 0.496093 |. 0.746093 | . 0.996093 


1.2 SPECIAL NUMBERS 


1.2.1 POWERS OF 2 


0.03125 


0.015625 
0.0078 125 
0.00390625 
0.001953125 
0.0009765625 


= Ооо з с\ \л мо н 
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2048 

4096 

8192 

16384 

32768 

65536 

131072 
262144 
524288 
1048576 
2097152 
4194304 
8388608 
16777216 
33554432 
67108864 
134217728 
268435456 
536870912 
1073741824 
2147483648 
4294967296 
8589934592 
17179869184 
34359738368 
68719476736 
137438953472 
274877906944 
549755813888 
1099511627776 


0.00048828 125 

0.000244 140625 

0.0001220703125 

0.00006103515625 

0.000030517578125 

0.0000152587890625 

0.00000762939453125 

0.000003814697265625 
0.0000019073486328125 

0.0000009536743 1640625 
0.000000476837158203125 
0.0000002384185791015625 
0.000000 1 1920928955078125 
0.000000059604644775390625 
0.0000000298023223876953125 
0.000000014901 16119384765625 
0.000000007450580596923828125 
0.0000000037252902984619140625 
0.00000000186264514923095703125 
0.000000000931322574615478515625 
0.0000000004656612873077392578125 
0.00000000023283064365386962890625 
0.0000000001 164.153218269348 14453125 
0.0000000000582076609134674072265625 
0.00000000002910383045673370361328125 
0.000000000014551915228366851806640625 
0.0000000000072759576141834259033203125 
0.0000000000036379788070917 1295 166015625 
0.000000000001 8 18989403545856475830078 125 
0.00000000000090949470 17729282379 150390625 


2199023255552 4398046511104 
8796093022208 17592186044416 
35184372088832 70368744177664 
140737488355328 2814749767 10656 
56294995342 1312 1125899906842624 


2251799813685248 4503599627370496 
9007199254740992 1801439850948 1984 
36028797018963968 72057594037927936 
144115188075855872 288230376151711744 
576460752303423488 115292 1504606846976 


23058430092 13693952 4611686018427387904 
9223372036854775808 18446744073709551616 
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36893488147419103232 
147573952589676412928 
5902958 10358705651712 


2361183241434822606848 
9444732965739290427392 
3777893 1862957 161709568 
15111572745 1828646838272 
6044629098073 14587353088 


241785 16392292583494 12352 
9671406556917033397649408 
38685626227668 133590597632 
1547425049 10672534362390528 
618970019642690137449562112 


73786976294838206464 
295 147905 179352825856 
11805916207 17411303424 


47223664828696452 13696 
1888946593 1478580854784 
75557863725914323419136 
30223 1454903657293676544 
1208925819614629174706176 


48357032784585 16698824704 

193428 13113834066795298816 
77371252455336267181195264 
30948500982 134506872478 1056 


16 

256 

4096 

65536 

1048576 

16777216 

268435456 

4294967296 

68719476736 
1099511627776 
175921860444 16 
2814749767 10656 
4503599627370496 
72057594037927936 
1152921504606846976 
18446744073709551616 
295147905 179352825856 
47223664828696452 13696 
755578637259 14323419136 
12089258196 14629174706176 
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1237940039285380274899 124224 


0.0625 

0.00390625 

0.000244 140625 

0.0000152587890625 

0.0000009536743 1640625 
0.000000059604644775390625 
0.00000000372529029846 19140625 
0.00000000023283064365386962890625 
0.00000000001455191522836685 1806640625 
0.0000000000009094947017729282379150390625 
5.684341886080801486968994140625 x 21% 
3.552713678800500929355621337890 - - - х 10-15 
2.220446049250313080847263336181 --- x 10776 
1.387778780781445675529539585113 --- x 1071" 
8.673617379884035472059622406959 --- x 107? 
5.421010862427522170037264004349 . - - х 10779 
3.388131789017201356273290002718 --- x 107?! 
2.117582368135750847670806251699 ... x 1072? 
1.323488980084844279794253907311 --- x 10723 
8.271806125530276748714086920699 --- x 10729 


1.2.3 POWERS OF 10 IN HEXADECIMAL SCALE 


0.19999999999999999999. . .1¢ 
0.028Е5С28Е5С28Е5С28Е5...16 
0.004189374BC6A7EF9DB2. ..16 
0.00068DB8BAC710CB295E. ..16 
0.0000А7С5АС471В478423...16 
F424016 | 0.000010C6F7AOB5ED8D 36. ..16 
98968016 | 0.000001 AD7F29ABCAF485...16 
5Е5Е100 16 | 0.0000002AF31DC4611873...16 
3B9ACA00 16 | 0.000000044В82ҒА09В5А5...16 
2540BE400 16 | 0.000000006DF37F675EF6. . .i¢ 
174876E800 16 | 0.000000000AFEBFFOBCB2. . .16 
E8D4A 51000 16 | 0.000000000119799812DE... 
9184E72A000 16 | 0.00000000001С25С26849... 
5AF3107A4000 16 | 0.000000000002D09370D4. . . 
15 | 38D7EA4C68000 16 | 0.000000000000480ЕВЕТВ... 
16 | 2386F26FC10000 16 | 0.0000000000000734АСА5... 


0 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 


1.2.4 SPECIAL CONSTANTS 
1.2.4.1 The constant т 


The transcendental number 7 is de ned as the ratio of the circumference of a circle 
to the diameter. It is also the ratio of the area of a circle to the square of the radius 
(r) and appears in several formulae in geometry and trigonometry (see Section 6.1) 


4 
circumference of a circle = 277, volume of a sphere = 477, 
area of a circle = rr”, surface area of a sphere = 477“. 
One method of computing т is to use the in nite series for the function tan ^! z and 
one of the identities 
т = 4 ап! 1 = 6 tan“! = 
УЗ 
4 424 a 1 -1 
- 2 ап z--2tan ---8tan -—2tan  —— 
2 3 5 239 (1.21) 
1 1 1 
= 24 tan“! = +8 tan“) — +4 tan“) — 
" 8 " 5 " 239 


1 1 1 
= 48 tan“)! — + 32 tan! — — 20 tan“ —— 
ал Sg Fon 708 ап 339 
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There are many other identities involving т. See Section 1.4.3. For example: 


2. 42 1 1 
£16: 8 c1 8144 8-5 8-6 


x = lim |2* 2+\/2+ 2+...+\/2+\/2 
k—o0 


k sguare roots 


k sguare roots 


9 со 
ШИН 2 
3 A (De 1 1 1 
Ey йы шы A 
32 = (2n + 1)? 27 125 343 
(1.2.2) 
To 200 decimal places: 
T 8:3. 14159 26535 89793 23846 26433 83279 50288 41971 69399 37510 


58209 74944 59230 78164 06286 20899 86280 34825 34211 70679 
82148 08651 32823 06647 09384 46095 50582 23172 53594 08128 
48111 74502 84102 70193 85211 05559 64462 29489 54930 38196 


To 50 decimal places: 


7/20 ғә 
71/15 ғ 
71/12 x 
7/11 x 
7/10 ғ 
71/9 s 
71/8 s 
n/T s 
71/6 ғ 
т/5 & 
т/4 x 
71/3 50 
т/2 s 
27/3 ғ 
37/2 ғ 


0.15707 96326 79489 66192 31321 69163 97514 42098 58469 96876 
0.20943 95102 39319 54923 08428 92218 63352 56131 44626 62501 
0.26179 93877 99149 43653 85536 15273 29190 70164 30783 28126 
0.28559 93321 44526 65804 20584 89389 04571 67451 97218 12501 
0.31415 92653 58979 32384 62643 38327 95028 84197 16939 93751 
0.34906 58503 98865 91538 47381 53697 72254 26885 74377 70835 
0.39269 90816 98724 15480 78304 22909 93786 05246 46174 92189 
0.44879 89505 12827 60549 46633 40468 50041 20281 67057 05359 
0.52359 87755 98298 87307 71072 30546 58381 40328 61566 56252 
0.62831 85307 17958 64769 25286 76655 90057 68394 33879 87502 
0.78539 81633 97448 30961 56608 45819 87572 10492 92349 84378 
1.04719 75511 96597 74615 42144 61093 16762 80657 23133 12504 
1.57079 63267 94896 61923 13216 91639 75144 20985 84699 68755 
2.09439 51023 93195 49230 84289 22186 33525 61314 46266 25007 
4.71238 89803 84689 85769 39650 74919 25432 62957 54099 06266 
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5т/2 ғә 7.85398 16339 74483 09615 66084 58198 75721 04929 23498 43776 
ут а 1.77245 38509 05516 02729 81674 83341 14518 27975 49456 12239 


In 1999 r was computed to 206, 158, 430, 208 = 3 · 236 decimal digits. The 
frequency distribution of the digits for 7 — 3, up to 200,000,000,000 decimal places, 
is: 


digit 0: 20000030841 digit 5: 19999917053 
digit 1: 19999914711 digit 6: 19999881515 
digit 2: 20000136978 digit 7: 19999967594 
digit 3: 20000069393 digit 8: 20000291044 
digit 4: 19999921691 digit 9: 19999869180 


1.2.4.2 The constant e 


The transcendental number e is the base of natural logarithms. It is given by 


тү" <1 
e= lim (1+2) = 220 (12.3) 
То 200 decimal places: 


e£ 2. 71828 18284 59045 23536 02874 71352 66249 77572 47093 69995 
95749 66967 62772 40766 30353 54759 45713 82178 52516 64274 
27466 39193 20030 59921 81741 35966 29043 57290 03342 95260 
59563 07381 32328 62794 34907 63233 82988 07531 95251 01901 


To 50 decimal places: 


e/8 & 0.33978 52285 57380 65442 00359 33919 08281 22196 55886 71249 
e/T as 0.38832 59754 94149 31933 71839 24478 95178 53938 92441 95714 
e/6 as 0.45304 69714 09840 87256 00479 11892 11041 62928 74515 61666 
е/5 а 0.54365 63656 91809 04707 20574 94270 53249 95514 49418 73999 
e/4% 0.67957 04571 14761 30884 00718 67838 16562 44393 11773 42499 
е/3ғ2 0.90609 39428 19681 74512 00958 23784 22083 25857 49031 23332 
e/2% 1.35914 09142 29522 61768 01437 35676 33124 88786 23546 84998 
2e/3 ға 1.81218 78856 39363 49024 01916 47568 44166 51714 98062 46664 
ет œ 23.14069 26327 79269 00572 90863 67948 54738 02661 06242 60021 
пе 2 22.45915 77183 61045 47342 71522 04543 73502 75893 15133 99669 


OR ee 
The function e” is de ned bye“ = 5 — (see page 521). The numbers е and т are 
ni 
=0 
related by the formula | 
е" = –1 (1.2.4) 
1.2.4.3 Тһе constant у 
Euler s constant y is de ned by 
— 1 
y= lim (>: гэн log 2 (12.5) 
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It is not known whether is rational or irrational. То 200 decimal places: 


y 30. 57721 56649 01532 86060 65120 90082 40243 10421 59335 93992 


1.2.4.4 


35988 05767 23488 48677 26777 66467 09369 47063 29174 67495 
14631 44724 98070 82480 96050 40144 86542 83622 41739 97644 
92353 62535 00333 74293 73377 37673 94279 25952 58247 09492 


The constant ф 
2 


The golden ratio, ©, is de ned as the positive root of the equation т = ne that 


is ф = уб. There is the continued fraction representation © = [1] (see Section 
2.4.4) and the representation in sguare roots 


424]1+V$1+V1+v1+... 


To 200 decimal places: 


ф % 1. 


61803 39887 49894 84820 45868 34365 63811 77203 09179 80576 
28621 35448 62270 52604 62818 90244 97072 07204 18939 11374 
84754 08807 53868 91752 12663 38622 23536 93179 31800 60766 
72635 44333 89086 59593 95829 05638 32266 13199 28290 26788 


1.2.4.5 Other constants 
To 50 decimal places 
V2s 1.41421 35623 73095 04880 16887 24209 69807 85696 71875 37695 
МЗ s 1.73205 08075 68877 29352 74463 41505 87236 69428 05253 81038 
45 s 2.23606 79774 99789 69640 91736 68731 27623 54406 18359 61153 
уб z 2.44948 97427 83178 09819 72840 74705 89139 19659 47480 65667 
УТ s 2.64575 13110 64590 59050 16157 53639 26042 57102 59183 08245 
У8 s 2.82842 71247 46190 09760 33774 48419 39615 71393 43750 75390 
2 s 0.69314 71805 59945 30941 72321 21458 17656 80755 00134 36026 
In3 x 1.09861 22886 68109 69139 52452 36922 52570 46474 90557 82275 
In5 s 1.60943 79124 34100 37460 07593 33226 18763 95256 01354 26852 
log2 ғә 0.30102 99956 63981 19521 37388 94724 49302 67681 89881 46211 
log3 ғә 0.47712 12547 19662 43729 50279 03255 11530 92001 28864 19070 
log5 = 0.69897 00043 36018 80478 62611 05275 50697 32318 10118 53789 


1.2.5 CONSTANTS IN DIFFERENT BASES 


Base 2 


mx 11.00100100001111110110101010001000100001011010001... 
ef 10.10110111111000010101000101100010100010101110110... 
yx 0.10010011110001000110011111100011011111011011000... 
v2% 1.01101010000010011110011001100111111100111011110... 
22 0.10110001011100100001011111110111110100011100111... 
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м bh) ом N N 


.11037552421026430215142306305056006701632112201... 
.55760521305053551246527734254200471723636166134... 
.44742147706766606172232157437601002513132552071... 
.32404746317716746220426276611546725125751743533... 
.54271027757507 17363257 11707316300077 13665364036... 


д 
OH OM боо 
о © © © © 


2% 
Base 12 
. 184809493B918664573A6211BB151551A05729290A78... 12 
.8752360698219BA71971009B388AA876676025642727...12 
.6B15188A6760B381B754334520434A22560A590A6A5... 12 
.4B79170A07B85737704B085486853504563650B559B8... 12 
.839912483369AB213742A34679253788658A1402A540... 1 


Q 
ов ом оо 


2% 
Ваѕе 16 
TX 


ел 


.24ЗЕ6А8885А3080313198А2Е03707344А4093822299Е...16 
.B7E151628AED2A6ABF7 158809CF4F3C762E7 160ЕЗ... 16 

. 93C467E37DBOC7A4D1BE3F810152CB56A1CECC3A... 16 

. GAOJEG6TF 3BCC908B2FB1366EFA957D3E3ADEC175... 16 
.B17217F7D1CF79ABC9OE3B39803F 2F6AF40F 3432672...16 


w 
гу 


2% 


2% 


OH OM оо 


1.2.6 FACTORIALS 


For non-negative integers n, the factorial of n, denoted n!, is the product of all pos- 
itive integers less than or equal to n; n! = п · (n — 1) - (n — 2)---2-1. If n is 
a negative integer (n = —1, —2,...) then n! = +оо. Note that, since the empty 
product is 1, it follows that 0! — 1. The generalization of the factorial function to 
non-integer arguments is the gamma function (see page 540). When n is an integer, 
T(n) = (n — 1)!. 
The double factorial of n, denoted n!!, is the product of every other integer: 
n! = п. (n — 2). (n — 4)---, where the last element in the product is either 2 
or 1, depending on whether n is even or odd. The shifted factorial (also called the 
rising factorial and Pochhammer’s symbol) is denoted by (а), (sometimes a") and 
is de ned as 
— 1)! 
ООО A] las Bla S S EE 2 L (1.2.6) 


n terms 


Approximations to n! for large n include Stirling’s formula 


n+ 
n! а vae (2) S (1.2.7) 
е 
and Burnsides"s formula 
1 
п+ 2 T 
n! z v 271 ( i) : (1.2.8) 
е 
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0.00000 0.00000 

0.00000 0.00000 

0.30103 0.30103 

0.77815 0.47712 

1.38021 0.90309 

2.07918 1.17609 

2.85733 1.68124 

3.70243 2.02119 

4.60552 2.58433 
3.6288 x 10° 5.55976 2.97543 
3.6288 x 106 6.55976 3.58433 
3.9917 x 10" 7.60116 4.01682 
4.7900 x 10% 8.68034 4.66351 
6.2270 x 10? 9.79428 | 1.3514 x 105 5.13077 
8.7178 х 1010 10.94041 | 6.4512 x 10° 5.80964 
1.3077 x 1012 12.11650 | 2.0270 x 106 6.30686 
2.0923 x 1019 13.32062 | 1.0322 x 107 7.01376 
3.5569 x 104 14.55107 | 3.4459 x 107 7.53731 
6.4024 x 1019 15.80634 | 1.8579 x 10% 8.26903 
1.2165 x 10!" 17.08509 | 6.5473 x 10% 8.81606 
2.4329 x 1018 18.38612 | 3.7159 x 10° 9.57006 
5.1091 x 10!? 19.70834 | 1.3749 x 1019 10.13828 
1.1240 x 10?! 21.05077 | 8.1750 x 1019 10.91249 
2.5852 x 107? 22.41249 | 3.1623 x 101! 11.50001 
6.2045 x 102% 23.79271 | 1.9620 x 10!? 12.29270 
1.5511 х 10% 25.19065 | 7.9059 x 1012 12.89795 
2.6525 x 10°? 32.42366 | 4.2850 x 1016 16.63195 
8.1592 x 1047 47.91165 | 2.5511 х 1074 24.40672 
3.0414 х 1094 64.48307 | 5.2047 x 1032 32.71640 
8.3210 x 10%! 81.92017 | 2.8481 x 10“! 41.45456 
1.1979 x 10199 100.07841 | 3.5504 х 1050 50.55028 
7.1569 х 10118 118.85473 | 8.9711 x 1099 59.95284 
1.4857 x 10198 138.17194 | 4.2088 x 106% 69.62416 
9.3326 x 10:57 157.97000 | 3.4243 x 1079 79.53457 
1.5882 х 10178 178.20092 | 4.5744 x 1089 89.66033 
6.6895 x 10:98 198.82539 | 9.5934 х 1099 99.98197 
6.4669 x 10219 219.81069 | 3.0428 x 1019 110.48328 
1.3462 x 10241 241.12911 | 1.4142 x 10121 121.15050 
5.7134 x 10262 262.75689 | 9.3726 x 10?! 131.97186 
1.2201 х 101154 1134.0864 | 5.8490 x 10567 567.76709 
4.0239 х 107567 2567.6046 | 3.9940 x 101281 1284.6014 
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1.2.7 BERNOULLI POLYNOMIALS AND NUMBERS 


The Bernoulli polynomials В „ (2) are de ned by the generating function 
test oo ғ 
af 2, Bale) (1.2.9) 
n— 


These polynomials can also be de ned recursively by means of Bo(x) = 1, B} (x) = 
nBy-1(x), and jo By, (x) ах = 0forn > 1. The identity Вк-+1(ж-+1)— Bk+1 (£) = 
(k + 1)x" means that sums of powers can be computed in terms of Bernoulli poly- 


nomials 
r Brsi(n+ 1) — Вь+1(0) 


1^ e 25 ++ 
И kl 


(1.2.10) 


(2x — 1)/2 
(6a? — 6x + 1)/6 


(22? — За? + x)/2 
(3024 — 602? + 302? — 1)/30 
(62? — 15x) + 10x? — r) /6 


The Bernoulli numbers are the Bernoulli polynomials evaluated at 0: В„ = 
со 
t” t 
В,(0). A generating function for the Bernoulli numbers is 5 Ва =F : 
= n! e! —1 
In the following table each Bernoulli number is written as a fraction of integers: 
Bn = Nn/Dn. Note that Bam = 0 form > 1. 


1 1 1.000000000 x 100 

—1 2 —5.000000000 x 107! 

1 6 1.666666667 x 107! 

—1 30  —3.333333333 x 107? 

1 42 2.380952381 x 107? 

—1 30  —3.333333333 x 107? 

5 66 7.575757576 x 10-2 

-691 2730 -2.531135531 x 1071 
7 6 1.166666667 x 10° 
—3617 510  —7.092156863 x 10° 
43867 798 5.497117794 x 10! 
—174611 330 -5.201242424 х 10? 
804513 138 6.192123188 x 10° 
—236364091 2730  —8.658025311 x 104 
8553103 6 1.425517167 х 106 
—23749461029 870  —2.729823107 x 107 
8615841276005 14322 6.015808739 x 10% 
— 7709321041217 510  —1.511631577 x 1019 
2511687858367 6 4.296146431 x 10!! 
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1.2.8 EULER POLYNOMIALS AND NUMBERS 


The Euler polynomials Е. (a) are de ned by the generating function 


деті Оо т 


r? -r 
(Ax? — ба? + 1)/4 
x) — 2r? + 2 
(225 — 51“ + 5x? — 1)/2 


(1.2.11) 


Alternating sums of powers can be computed in terms of Euler polynomials 


УЛ-1 5 a oe = 5 


E,(n 4-1) + D” Ex (0) 


(1.2.12) 


The Euler numbers are the Euler polynomials evaluated at 1/2, and scaled: 


En = 2^ E, (1). A generating function for the Euler numbers is 


—199360981 

19391512145 

— 2404379675441 

370371188237525 

—69348874393137901 

15514534163557086905 
—4087072509293123892361 
1252259641403629865468285 
—441543893249023104553682821 
177519391579539289436664789665 
—80723299235887898062168247453281 
41222060339517702122347079671259045 
—23489580527043108252017828576198947741 
40 | 14851150718114980017877156781405826684425 
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(1.2.13) 


1.2.9 FIBONACCI NUMBERS 


The Fibonacci numbers { Р, + are de ned by the recurrence: 


и Bal. Fig] horn, (1.2.14) 


Б” ee 
| 5 )-( 5 | (1.2.15) 


= ф, the golden ratio. Also, Fa ~ Ф"/у5 as n — oo. 


An exact formula is available: 


1 
Fn = ж 


Еді 


Note that lim 
n oo 


196418 102334155 
317811 165580141 
514229 267914296 
832040 433494437 
1346269 701408733 
2178309 1134903170 


3524578 1836311903 
5702887 2971215073 
9227465 4807526976 
14930352 7778742049 
24157817 | 50 12586269025 
39088169 | 51 20365011074 
63245986 | 52 32951280099 


1.2.10 POWERS OF INTEGERS 


16 128 256 1024 
81 243 729 2187 6561 59049 
256 1024 4096 16384 65536 1048576 
625 3125 15625 78125 390625 9765625 


1296 7776 46656 279936 1679616 60466176 
2401 16807 117649 823543 5764801 282475249 
4096 32768 262144 2097152 16777216 1073741824 
6561 59040 531441 4782969 43046721 3486784401 
10000 100000 1000000 10000000 100000000 10000000000 
14641 161051 1771561 19487171 214358881 25937424601 
20736 248832 2985984 35831808 429981696 61917364224 


о NOU > шо го н 
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1.2.11 


SUMS ОЕ POWERS OF INTEGERS 


1. Dene 


n 
selin) = 15 25 En = У т. (1.2.16) 
т-і1 


Properties include: 


(a) sk(n) = (k + 1)7 [Bia (n + 1) — Bia (0) 


(where the В; are Bernoulli polynomials, see Section 1.2.7). 


(b) If s(n) = VŠE, арад "2, then 


(c) 


n 


k +2 k 
k+1 9 
Te "97 арі” + 


1 
sı(n)=1+2+3+: +n = gn(n 1) 


k+1 k+1 
sat) = ( T Jas? ee (AES) azn” 
k+1 5 
1- 1 == 
wend: ete 


: 1 
во(т) = V +2 +3? +: +n? = сп(п + DEN +1) 


1 
ss(n) =1 E Z7 E35 bob ап (0417 = |а (т) 


1 
sa(n) = 14+ 21+ 34+... + п“ = = Gn + 3n — 1)ss(n) 
1 
в5(п) 2 1° +2 35 Fn = ino 1)? (2n? + 2n — 1) 


se(n) = 18 + 28 +36 +... +n’ 
n 


= — (n + 1)(2n + 1)(3n* + 6n? — 3n + 1). 
42 


2. 3 (Ет —1)= тиб +1) л 


k=1 


n 


з. Y (km — 1)? = 5 [m?(n + 1)(2n +1) —6m(n +1) + 6] 


k=1 


n 


4. Y“(km—1)? = i [m3n(n + 1)? — 2m? (n + 1) (2n + 1) + 6m(n + 1) — 4] 
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5. NL)! (km si js алы [2 — (2n + 1)m] + "=? 


4 


6. УС! (km—1)? = [у= [n(n + 1)m? — (2n + 1)m + 1] Раш = 


2 
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17 33 

36 98 276 
100 354 1300 
225 979 4425 


441 2275 12201 
784 4676 29008 
1296 8772 61776 
2025 15333 120825 
3025 25333 220825 


4356 39974 381876 
6084 60710 630708 


8281 89271 1002001 
11025 127687 1539825 
14400 178312 2299200 


18496 243848 3347776 
23409 327369 4767633 
29241 432345 6657201 
36100 562666 9133300 
44100 722666 12333300 


53361 917147 16417401 
64000 1151403 21571033 
76176 1431244 28007376 
90000 1763020 35970000 
105625 2153645 45735625 


1.2.12 МЕСАТІУЕ ІМТЕСЕН POWERS 


Riemann s zeta function is С(п) = VEL рт (itis de ned for Ке k > 1 and extended 
to C). Related functions are 


k=1 k=0 k=0 
Properties include: 
1. а(п)-(1-21-")((а) 3. y(n) -(1-2-")а) 
Qn) 2k+1 
2. С(2Е) = S |В, _ (1/2) 
2(2k)! 4. B(2k - 1) = Om! | эь 
5. The series (1) = 1 — $ + 1 — - -- = т/4 is known as Gregory s series. 


6. Catalan’s constant is G = 8(2) ғ 0.915966. 
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7. Riemann hypothesis: The non-trivial zeros of the Riemann zeta function (1.е., 
the {z;} that satisfy ¢(z;) = 0) lie on the critical line given by Re 2; = 


(The trivial zeros аге z = —2, —4, —6,....) 


1.6449340669 
1.2020569032 
1.0823232337 
1.0369277551 
1.0173430620 
1.0083492774 
1.0040773562 
1.0020083928 
1.0009945752 
1.0004941886 
1.0002460866 
1.0001227133 
1.0000612482 
1.0000305882 
1.0000152823 
1.0000076372 
1.0000038173 
1.0000019082 
1.0000009540 


0.693 1471805 
0.8224670334 
0.9015426773 
0.9470328294 
0.9721197705 
0.9855510912 
0.9925938199 
0.9962330018 
0.9980942975 
0.9990395075 
0.9995171435 
0.9997576851 
0.9998785428 
0.9999391703 
0.9999695512 
0.9999847642 
0.9999923783 
0.9999961879 
0.9999980935 
0.9999990466 


В(1 = т/4 

B(3) = 7? /32 

8(5) = 515 /1536 

B(T) = 61x7 /184320 
8(9) = 2771? /8257536 


1.2.13 DEBRUIJN SEQUENCES 


0.7853981633 

0.9159655941 
0.9689461463 
0.9889445517 
0.9961578281 
0.9986852222 
0.9995545079 
0.9998499902 
0.9999496842 
0.9999831640 
0.9999943749 
0.9999981224 
0.9999993736 
0.9999997911 
0.9999999303 
0.9999999768 
0.9999999923 
0.9999999974 
0.9999999991 
0.9999999997 


(0) = т°/6 
С(4) = 75/90 
С(6) = «5/945 
С(8) = «5/9450 
са 


1.2337005501 
1.0517997903 
1.0146780316 
1.0045237628 
1.0014470766 
1.0004715487 
1.0001551790 
1.0000513452 
1.0000170414 
1.0000056661 
1.0000018858 
1.0000006281 
1.0000002092 
1.0000000697 
1.0000000232 
1.0000000077 
1.0000000026 
1.0000000009 
1.0000000003 


0) = л19/93555 


2: 


А seguence of length g" over an alphabet of size g is a de Bruijn seguence 1f every 
possible n-tuple occurs in the seguence (allowing wraparound to the start of the 
seguence). There are de Bruijn seguences for any g and n. The table below gives 
some small examples. 


г Гепа Sequence] 
2 01 


211 


01110100 


0101001101111000 
001220211 
0011310221203323 
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1.2.14 INTEGER SEGUENCES 


These sequences are arranged in numerical order (disregarding any leading zeros or 
ones). Note that C(n, k) = (1): see page 206. 


1. 


10. 


11. 


12. 


13. 


14. 


1, —1, —1, 0, —1, 1, —1, 0, 0, 1, —1, 0, —1, 1, 1, 0, —1, 0, 21,0, 1, 1, —1, 0, 0, g 
0, —1, —1, —1, 0, 1, 1, 1, 0, —1, 1, 1, 0, —1, —1, —1, 0, 0, 1, —1, 0, 0, 0, 1, 0, —1,0, 
1,0 Möbius function u(n), n > 1 
1, 1,0, 1, 1,0, 0, 1, 1, 1, 0, O, 1, 0, 0, 1, 1, 1, 0, 1, 0, 0, 0, 0, 2, 1, 0, O, 1, 0, 0, 1, 0, 1, 
0, 1, 1,0, 0, 1, 1, 0, 0, 0, 1, 0, 0, 0, 1, 2, 0, 1, 1, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 1, 2, 0, 0, 1 

0 Number of ways of writing n as a sum of 2 squares, n > 0 
O, 11 1, 1;2,.1, 1;1,2;1,2;1;2,2.1,1,2,15,2;25 2, 1;2.:1,2; 1:2; 1:3, 1.1, 2:2; 
2,2;1,2;2,2,1;3,1,2;2:2;1.2,;1,2;2,2,1,2;2;2,2; 2; 15 3, 1;2;2, 1,2, 3 1, 2; 
2 umber of distinct primes dividing n, n > 1 
1, 1, 1,2, 1, 1, 1, 3, 2, 1, 1, 2, 1, 1, 1, 5, 1, 2, 1, 2, 1, 1, 1, 3, 2, 1, 3, 2, 1, 1, 1, 7, 1, 1, 
1, 4, 1, 1, 1, 3, 1, 1, 1, 2, 2, 1, 1, 5, 2, 2, 1, 2, 1, 3, 1, 3, 1, 1, 1, 2, 1, 1,2, 11, 1, 1, 1, 
2 Number of abelian groups of order n, n > 1 
1,1,1,2, 1,2,1, 33.252, 1,5, 1,2,1, 14, 15-1, 5,22, 115,2, 2.514, 15,4, 1,51, 
1, 2, 1, 14, 1, 2, 2, 14, 1, 6, 1, 4, 2, 2, 1, 52, 2, 5, 1, 5, 1, 15, 2, 13, 2, 2, 1, 13, 1, 2, 4, 
267 Number of groups of order n, n > 1 
0, 1, 1, 2, 1, 2, 2, 3, 1, 2, 2, 3, 2, 3, 3, 4, 1, 2, 2, 3, 2, 3, 3, 4, 2, 3, 3, 4, 3, 4, 4, 5, 1, 2, 
2, 3, 2, 3, 3, 4, 2, 3, 3, 4, 3, 4, 4, 5, 2, 3, 3, 4, 3, 4, 4, 5, 3, 4, 4, 5, 4, 5, 5, 6, 1, 2, 2, 3, 
2 Number of 1’s in binary expansion of n, n > 0 


1, 2, 1, 2, 3, 6, 9, 18, 30, 56, 99, 186, 335, 630, 1161, 2182, 4080, 7710, 14532, 27594, 
52377, 99858, 190557, 364722, 698870, 1342176, 2580795, 4971008 
Number of binary irreducible polynomials of degree n, or n-bead necklaces, n > 0 
1, 1, 1, 2, 1, 3, 1, 4, 2, 3, 1, 8, 1, 3, 3, 8, 1, 8, 1, 8, 3, 3, 1, 20, 2, 3, 4, 8, 1, 13, 1, 16, 3, 
3, 3, 26, 1, 3, 3, 20, 1, 13, 1, 8, 8, 3, 1, 48, 2, 8, 3, 8, 1, 20, 3, 20, 3, 3, 113 

Number of perfect partitions of n, or ordered factorizations of n + 1, п > 0 
1 Lili, 2; 2,1,1 2.1.7272. 1,2, TL Ded 2 2, 11: 2,2,1, 2,1471, 22, 1, 
1 2,.1,1,2,2,1,2,1,1,2,1,2,2,1,2,:1,1,2, 2,1, 1,2,1,2,2, 1,.2, 1, 1, 2; 
1 Thue-Morse non-repeating sequence 
1, 2, 1, 4, 1, 2, 1, 8, 1,2, 1,4, 1,2, 1,9, 1,2, 1, 4, 1,2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 10, 1, 2, 
1,4,1 1, 8, 1, 2, 1, 4, 1, 2, 1, 9, 1, 2, 1, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 12, 1,2, 1, 
4 Hurvitz-Radon numbers 
1 3,4,2, 6, 2, 4, 4, 5, 2, 6, 2, 6, 4, 4, 2, 8, 3, 4, 4, 6, 2, 8, 2, 6, 4, 4, 
4 , 2, 8, 2, 6, 6, 4, 2, 10, 3, 6, 4, 6, 2, 8, 4, 8, 4, 4, 2, 12, 2, 4, 6, 7, 4, 8, 2, 
6 d(n), the number of divisors of n, n > 1 
0, 1, 2, 2, 3, 3, 4, 4, 4, 4, 5, 5, 6, 6, 6, 6, 7, 7, 8, 8, 8, 8, 9, 9, 9, 9, 9, 9, 10, 10, 11, 11, 
11, 11, 11, 11, 12, 12, 12, 12, 13, 13, 14, 14, 14, 14, 15, 15, 15, 15, 15, 15, 16, 16, 16, 
16 7 (n), the number of primes < n, for n > 1 
1, 1, 2, 2, 3, 4, 5, 6, 8, 10, 12, 15, 18, 22, 27, 32, 38, 46, 54, 64, 76, 89, 104, 122, 
142, 165, 192, 222, 256, 296, 340, 390, 448, 512, 585, 668, 760, 864, 982, 1113, 1260, 
1426 Number of partitions of n into distinct parts, n > 1 
1, 1, 2, 2, 4, 2, 6, 4, 6, 4, 10, 4, 12, 6, 8, 8, 16, 6, 18, 8, 12, 10, 22, 8, 20, 12, 18, 12, 28, 
8, 30, 16, 20, 16, 24, 12, 36, 18, 24, 16, 40, 12, 42, 20, 24, 22, 46, 16, 42 

Euler totient function Ф(п): count numbers < n and prime to n, for n > 1 
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15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


26. 


27. 


28. 


29. 


1, 1, 1, 0, 1, 1, 2, 2, 4, 5, 10, 14, 26, 42, 78, 132, 249, 445, 842, 1561, 2988, 5671, 
10981, 21209, 41472, 81181, 160176, 316749, 629933, 1256070, 2515169, 5049816 
Number of series-reduced trees with n unlabeled nodes, n > 0 


1, 2, 3, 4, 5, 7, 8, 9, 11, 13, 16, 17, 19, 23, 25, 27, 29, 31, 32, 37, 41, 43, 47, 49, 53, 
59, 61, 64, 67, 71, 73, 79, 81, 83, 89, 97, 101, 103, 107, 109, 113, 121, 125, 127, 128, 
131 Powers of prime numbers 


1, 2, 3, 4, 6, 8, 10, 12, 16, 18, 20, 24, 30, 36, 42, 48, 60, 72, 84, 90, 96, 108, 120, 144, 
168, 180, 210, 216, 240, 288, 300, 336, 360, 420, 480, 504, 540, 600, 630, 660 
Highly abundant numbers: where sum-of-divisors function increases 


1, 2, 3, 4, 6, 8, 11, 13, 16, 18, 26, 28, 36, 38, 47, 48, 53, 57, 62, 69, 72, 77, 82, 87, 
97, 99, 102, 106, 114, 126, 131, 138, 145, 148, 155, 175, 177, 180, 182, 189, 197, 206, 
209 Ulam numbers: next is uniguely the sum of 2 earlier terms 


2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 53, 59, 60, 61, 67, 71, 73, 79, 
83, 89, 97, 101, 103, 107, 109, 113, 127, 131, 137, 139, 149, 151, 157, 163, 167, 168, 
173 Orders of simple groups 


2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 53, 59, 61, 67, 71, 73, 79, 83, 89, 
97, 101, 103, 107, 109, 113, 127, 131, 137, 139, 149, 151, 157, 163, 167, 173, 179, 
181 Prime numbers 


1, 2, 3, 5, 7, 11, 15, 22, 30, 42, 56, 77, 101, 135, 176, 231, 297, 385, 490, 627, 792, 
1002, 1255, 1575, 1958, 2436, 3010, 3718, 4565, 5604, 6842, 8349, 10143, 12310, 
14883 Number of partitions of n, n > 1 


2, 3, 5, 7, 13, 17, 19, 31, 61, 89, 107, 127, 521, 607, 1279, 2203, 2281, 3217, 
4253, 4423, 9689, 9941, 11213, 19937, 21701, 23209, 44497, 86243, 110503, 132049, 
216091, 756839, 859433 Mersenne primes: n such that 2” — 1 is prime 


1, 1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144, 233, 377, 610, 987, 1597, 2584, 4181, 
6765, 10946, 17711, 28657, 46368, 75025, 121393, 196418, 317811, 514229, 832040, 
1346269 Fibonacci numbers: F(n) = F(n — 1) + F(n — 2) 
1, 2, 3, 6, 10, 20, 35, 70, 126, 252, 462, 924, 1716, 3432, 6435, 12870, 24310, 48620, 
92378, 184756, 352716, 705432, 1352078, 2704156, 5200300, 10400600, 20058300 
Central binomial coefficients: C(n, |n/2]),n > 1 


1, 1, 2, 3, 6, 11, 20, 40, 77, 148, 285, 570, 1120, 2200, 4323, 8498, 16996, 33707, 
66844, 132568, 262936, 521549, 1043098, 2077698, 4138400, 8243093 
Stern's sequence: a(n 4- 1) is sum of preceding == | terms, n > 1 


1, 1, 2, 3, 6, 11, 22, 42, 84, 165, 330, 654, 1308, 2605, 5210, 10398, 20796, 41550, 

83100, 166116, 332232, 664299, 1328598, 2656866, 5313732, 10626810 
Narayana-Zidek-Capell numbers: a(2n) = 2a(2n — 1), a(2n + 1) = 2a(2n) — 

a(n) 

1, 1, 1, 2, 3, 6, 11, 23, 46, 98, 207, 451, 983, 2179, 4850, 10905, 24631, 56011, 127912, 

293547, 676157, 1563372, 3626149, 8436379, 19680277, 46026618, 107890609 

Wedderburn-Etherington numbers: interpretations of X”, n > 1 

1, 1, 1, 2, 3, 6, 11, 23, 47, 106, 235, 551, 1301, 3159, 7741, 19320, 48629, 123867, 

317955, 823065, 2144505, 5623756, 14828074, 39299897, 104636890, 

279793450 Number of trees with n unlabeled nodes, n > 1 


2, 3, 6, 20, 168, 7581, 7828354, 2414682040998, 56130437228687557907788 
Dedekind numbers: number of monotone Boolean functions of n variables, n > 0 
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30. 


31. 


32. 


33. 


34. 


35. 


36. 


37. 


38. 


39. 


40. 


41. 


42. 


43. 


44. 


45. 


1, 1, 2, 3, 7, 16, 54, 243, 2038, 33120, 1182004, 87723296, 12886193064, 
3633057074584, 1944000150734320, 1967881448329407496 
Number of Euler graphs or 2-graphs with n nodes, n > 1 


0,0, 1, 1, 2, 3, 7, 18, 41, 123, 367, 1288, 4878 
Number of alternating prime knots with n crossings, n > 1 


0,0, 1, 1, 2, 3, 7, 21, 49, 165, 552, 2176, 9988 
Number of prime knots with n crossings, n > 1 


1, 1, 2, 3, 8, 14, 42, 81, 262, 538, 1828, 3926, 13820, 30694, 110954, 252939, 933458, 
2172830, 8152860, 19304190, 73424650, 176343390, 678390116, 1649008456 
Meandric numbers: ways a river can cross a road n times, n > 1 


0, 1, 2, 4, 5, 8, 9, 10, 13, 16, 17, 18, 20, 25, 26, 29, 32, 34, 36, 37, 40, 41, 45, 49, 50, 
52, 53, 58, 61, 64, 65, 68, 72, 73, 74, 80, 81, 82, 85, 89, 90, 97, 98, 100, 101, 104, 
106 Numbers that are sums of 2 squares 


1, 2, 4, 5, 8, 10, 14, 15, 16, 21, 22, 25, 26, 28, 33, 34, 35, 36, 38, 40, 42, 46, 48, 49, 50, 
53, 57, 60, 62, 64, 65, 70, 77, 80, 81, 83, 85, 86, 90, 91, 92, 100, 104, 107 
MacMahon's prime numbers of measurement, or segmented numbers 


1, 2, 4, 6, 10, 14, 20, 26, 36, 46, 60, 74, 94, 114, 140, 166, 202, 238, 284, 330, 390, 
450, 524, 598, 692, 786, 900, 1014, 1154, 1294, 1460, 1626, 1828, 2030, 2268, 2506 
Binary partitions (partitions of 2n into powers of 2), > 0 


1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8192, 16384, 32768, 65536, 
131072, 262144, 524288, 1048576, 2097152, 4194304, 8388608, 16777216, 
33554432, 67108864, 134217728, 268435456, 536870912 Powers of 2 


l, 1, 2, 4, 9, 20, 48, 115, 286, 719, 1842, 4766, 12486, 32973, 87811, 235381, 
634847, 1721159, 4688676, 12826228, 35221832, 97055181, 268282855, 743724984, 
2067174645 Number of rooted trees with n unlabeled nodes, n > 1 


1, 1, 2, 4, 9, 21, 51, 127, 323, 835, 2188, 5798, 15511, 41835, 113634, 310572, 853467, 
2356779, 6536382, 18199284, 50852019, 142547559, 400763223, 1129760415 
Motzkin numbers: ways to join n points on a circle by chords 


1, 1, 2, 4, 9, 22, 59, 167, 490, 1486, 4639, 14805, 48107, 158808, 531469, 1799659, 
6157068, 21258104, 73996100, 259451116, 951695102, 3251073303 
Number of different scores in n-team round-robin tournament, n > 1 


1, 1, 2, 4, 11, 34, 156, 1044, 12346, 274668, 12005168, 1018997864, 
165091172592, 50502031367952, 29054155657235488, 31426485969804308768 
Number of graphs with n unlabeled nodes, n > 0 


0, 1, 2, 5, 12, 29, 70, 169, 408, 985, 2378, 5741, 13860, 33461, 80782, 195025, 
470832, 1136689, 2744210, 6625109, 15994428, 38613965, 93222358, 225058681, 
543339720 Pell numbers: a(n) = 2a(n — 1) + a(n — 2) 


1, 1, 2, 5, 12, 35, 108, 369, 1285, 4655, 17073, 63600, 238591, 901971, 3426576, 
13079255, 50107909, 192622052, 742624232, 28770671950, 11123060678, 
43191857688, 168047007728, 654999700403 Polyominoes with n cells, n > 1 


1, 1, 2, 4, 12, 56, 456, 6880, 191536, 9733056, 903753248, 154108311168, 
48542114686912, 28401423719122304, 31021002160355166848 
Number of outcomes of n-team round-robin tournament, n > 1 


1, 1, 2, 5, 14, 38, 120, 353, 1148, 3527, 11622, 36627, 121622, 389560, 1301140, 


4215748, 13976335, 46235800, 155741571, 512559185, 1732007938, 
5732533570 Number of ways to fold a strip of blank stamps, n > 1 
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46. 


47. 


48. 


49. 


50. 


51. 


52. 


53. 


54. 


55. 


56. 


57. 


58. 


59. 


60. 


1, 1, 2, 5, 14, 42, 132, 429, 1430, 4862, 16796, 58786, 208012, 742900, 2674440, 
9694845, 35357670, 129644790, 477638700, 1767263190, 6564120420, 
24466267020 Catalan numbers: C(2n,n)/(n + 1),n > 0 


1, 1, 2, 5, 15, 52, 203, 877, 4140, 21147, 115975, 678570, 4213597, 27644437, 
190899322, 1382958545, 10480142147, 82864869804, 682076806159, 
5832742205057 Bell or exponential numbers: expansion of с( ^? 


1, 1, 1, 2, 5, 16, 61, 272, 1385, 7936, 50521, 353792, 2702765, 22368256, 199360981, 
1903757312, 19391512145, 209865342976, 2404879675441, 
29088885112832 Euler numbers: expansion of sec x 4- tan x 


0, 2, 6, 12, 20, 30, 42, 56, 72, 90, 110, 132, 156, 182, 210, 240, 272, 306, 342, 380, 
420, 462, 506, 552, 600, 650, 702, 756, 812, 870, 930, 992, 1056, 1122, 1190, 1260, 
1332 Pronic numbers: n(n + 1), n > 0 


1, 2, 6, 20, 70, 252, 924, 3432, 12870, 48620, 184756, 705432, 2704156, 10400600, 
40116600, 155117520, 601080390, 2333606220, 9075135300, 
35345263800 Central binomial coefficients: C (2n, n), n > 0 


1, 1, 1, 2, 6, 21, 112, 853, 11117, 261080, 11716571, 1006700565, 
164059830476, 50335907869219, 29003487462848061, 31397381142761241960 
Number of connected graphs with n unlabeled nodes, n > 0 


1, 2, 6, 22, 101, 573, 3836, 29228, 250749, 2409581, 25598186, 296643390, 
3727542188, 50626553988, 738680521142 
Kendall-Mann numbers: maximal inversions in permutation of n letters, n > 1 


1, 1, 2, 6, 24, 120, 720, 5040, 40320, 362880, 3628800, 39916800, 479001600, 
6227020800, 87178291200, 1307674368000, 20922789888000, 355687428096000, 
6402373705728000 Factorial numbers: n!, n > 0 


1, 2, 7, 42, 429, 7436, 218348, 10850216, 911835460, 129534272700, 
31095744852375, 12611311859677500, 8639383518297652500 
Robbins numbers: [[7; (3k + 1)!/(n + k)hn > 1 


1, 2, 8, 42, 262, 1828, 13820, 110954, 933458, 8152860, 73424650, 678390116, 
6405031050, 61606881612, 602188541928, 5969806669034, 59923200729046 
Closed meandric numbers: ways a loop can cross a road 2n times, n > 1 


1, 2, 8, 48, 384, 3840, 46080, 645120, 10321920, 185794560, 3715891200, 
81749606400, 1961990553600, 51011754393600, 1428329123020800, 
42849873690624000 Double factorial numbers: (2n)!! = 2°п!, n > 0 


0, 1, 2, 9, 44, 265, 1854, 14833, 133496, 1334961, 14684570, 176214841, 2290792932, 
32071101049, 481066515734, 7697064251745, 130850092279664 
Derangements: permutations of n elements with no fixed points, n > 1 


1, 2, 16, 272, 7936, 353792, 22368256, 1903757312, 209865342976, 
29088885112832, 4951498053124096, 1015423886506852352, 
246921480190207983616 Tangent numbers: expansion of tan x 


1, 3, 4, 7, 6, 12, 8, 15, 13, 18, 12, 28, 14, 24, 24, 31, 18, 39, 20, 42, 32, 36, 24, 60, 
31, 42, 40, 56, 30, 72, 32, 63, 48, 54, 48, 91, 38, 60, 56, 90, 42, 96, 44, 84, 78, 72, 48, 
124 a(n), sum of the divisors of n, n > 1 
1, 3, 4, 7, 9, 12, 13, 16, 19, 21, 25, 27, 28, 31, 36, 37, 39, 43, 48, 49, 52, 57, 61, 63, 
64, 67, 73, 75, 76, 79, 81, 84, 91, 93, 97, 100, 103, 108, 109, 111, 112, 117, 121, 124, 
127 Numbers of the form x“ + zy + y? 
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61. 


62. 


63. 


64. 


65. 


66. 


67. 


68. 


69. 


70. 


71. 


72. 


73. 


74. 


75. 


76. 


1, 3, 4, 7, 11, 18, 29, 47, 76, 123, 199, 322, 521, 843, 1364, 2207, 3571, 5778, 9349, 
15127, 24476, 39603, 64079, 103682, 167761, 271443, 439204, 710647, 1149851, 
1860498 Lucas numbers: L(n) = L(n — 1) + L(n — 2) 


1, 1, 1, 3, 4, 12, 27, 82, 228, 733, 2282, 7528, 24834, 83898, 285357, 983244, 
3412420, 11944614, 42080170, 149197152, 531883768, 1905930975, 6861221666, 
24806004996 Number of ways to cut an n-sided polygon into triangles, n > 1 


1, 3, 6, 10, 15, 21, 28, 36, 45, 55, 66, 78, 91, 105, 120, 136, 153, 171, 190, 210, 231, 
253, 2776, 300, 325, 351, 378, 406, 435, 465, 496, 528, 561, 595, 630, 666, 703, 741, 
780 Triangular numbers: n(n + 1)/2,n > 1 


1,3, 6, 11, 17, 25, 34, 44, 55, 72, 85, 106, 127, 151 
Shortest Golomb ruler with n marks, n > 2 


1, 3, 6, 13, 24, 48, 86, 160, 282, 500, 859, 1479, 2485, 4167, 6879, 11297, 18334, 
29601, 47330, 75278, 118794, 186475, 290783, 451194, 696033, 1068745, 1632658 
Number of planar partitions of n,n > 1 


1, 3, 7, 9, 13, 15, 21, 25, 31, 33, 37, 43, 49, 51, 63, 67, 69, 73, 75, 79, 87, 93, 99, 
105, 111, 115, 127, 129, 133, 135, 141, 151, 159, 163, 169, 171, 189, 193, 195, 201, 
205 Lucky numbers (defined by sieve similar to prime numbers) 


1, 3, 7, 19, 47, 130, 343, 951, 2615, 7318, 20491, 57903, 163898, 466199, 1328993, 
3799624, 10884049, 31241170, 89814958, 258604642 
Number of mappings from n unlabeled points to themselves, n > 1 


1, 3, 9, 25, 65, 161, 385, 897, 2049, 4609, 10241, 22529, 49153, 106497, 229377, 
491521, 1048577, 2228225, 4718593, 9961473, 20971521, 44040193, 
92274689 Cullen numbers: n · 2” + 1, п > 0 


1, 3, 9, 27, 81, 243, 729, 2187, 6561, 19683, 59049, 177147, 531441, 1594323, 
4782969, 14348907, 43046721, 129140163, 387420489, 1162261467, 3486784401, 
10460353203 Powers of 3 


1, 3, 9, 33, 139, 718, 4535 
Number of topologies or transitive-directed graphs with n unlabeled nodes, n > 1 


1, 1, 3, 11, 45, 197, 903, 4279, 20793, 103049, 518859, 2646723, 13648869, 71039373, 
372693519, 1968801519, 10463578353, 55909013009, 300159426963 
Schroeder’s second problem: ways to interpret X; Xo... X4,,n > 1 


1, 3, 11, 50, 274, 1764, 13068, 109584, 1026576, 10628640, 120543840, 1486442880, 
19802759040, 283465647360, 4339163001600, 70734282393600, 
1223405590579200 Stirling cycle numbers: [5], n > 2. 


2 
1, 3, 13, 75, 541, 4683, 47293, 545835, 7087261, 1022477563, 1622632573, 
28091567595, 526858348381, 10641342970443, 230283190977853, 
5315654681981355 Preferential arrangements of n things, n > 1 


1, 3, 15, 105, 945, 10395, 135135, 2027025, 34459425, 654729075, 13749310575, 
316234143225, 7905853580625, 213458046676875, 6190283353629375 

Double factorial numbers: (2n + 1)! = 1:3: 5--- (2n - 1,n 21 
1, 3, 16, 125, 1296, 16807, 262144, 4782969, 100000000, 2357947691, 


61917364224, 1792160394037, 56693912375296, 1946195068359375, 
72057594037927936 Number of trees with n labeled nodes: n^^?, n > 2 


1, 3, 16, 218, 9608, 1540944, 882033440, 1793359192848, 13027956824399552, 
341260431952972580352, 32522909385055886111197440 
Directed graphs with n unlabeled nodes, n > 1 
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77. 


78. 


79. 


80. 


81. 


82. 


83. 


84. 


85. 


86. 


87. 


88. 


89. 


90. 


91. 


1, 1, 3, 17, 155, 2073, 38227, 929569, 28820619, 1109652905, 51943281731, 
2905151042481, 191329672483963, 14655626154768697, 1291885088448017715 
Genocchi numbers: expansion of tan(r/2) 


0, 1, 4, 5, 16, 17, 20, 21, 64, 65, 68, 69, 80, 81, 84, 85, 256, 257, 260, 261, 272, 273, 
276, 277, 320, 321, 324, 325, 336, 337, 340, 341, 1024, 1025, 1028, 1029, 1040, 1041 
Moser-de Bruijn sequence: sums of distinct powers of 4 


4, 7, 8, 9, 10, 11, 12, 12, 13, 13, 14, 15, 15, 16, 16, 16, 17, 17, 18, 18, 19, 19, 19, 
20, 20, 20, 21, 21, 21, 22, 22, 22, 23, 23, 23, 24, 24, 24, 24, 25, 25, 25, 25, 26, 26, 
26 Chromatic number of surface of genus n, n > 0 


1, 4, 9, 16, 25, 36, 49, 64, 81, 100, 121, 144, 169, 196, 225, 256, 289, 324, 361, 400, 
441, 484, 529, 576, 625, 676, 729, 784, 841, 900, 961, 1024, 1089, 1156, 1225, 1296 
The squares 


1, 4, 10, 19, 31, 46, 64, 85, 109, 136, 166, 199, 235, 274, 316, 361, 409, 460, 514, 
571, 631, 694, 760, 829, 901, 976, 1054, 1135, 1219, 1306, 1396, 1489, 1585, 1684, 
1786 Centered triangular numbers: (3n? + 3n + 2) /2, n > 0 


1, 4, 10, 20, 35, 56, 84, 120, 165, 220, 286, 364, 455, 560, 680, 816, 969, 1140, 1330, 
1540, 1771, 2024, 2300, 2600, 2925, 3276, 3654, 4060, 4495, 4960, 5456, 5984 
Tetrahedral numbers: C (n + 3, 3), n > 0 


1, 1, 4, 26, 236, 2752, 39208, 660032, 12818912, 282137824, 6939897856, 
188666182784, 5617349020544, 181790703209728, 6353726042486272 
Schroeder's fourth problem: families of subsets of an n set, n > 1 


1, 4, 29, 355, 6942, 209527, 9535241, 642779354, 63260289423, 
8977053873043, 1816846038736192, 519355571065774021 
Number of transitive-directed graphs with n labeled nodes, n > 1 


1, 5, 12, 22, 35, 51, 70, 92, 117, 145, 176, 210, 247, 287, 330, 376, 425, 477, 532, 
590, 651, 715, 782, 852,925, 1001, 1080, 1162, 1247, 1335, 1426, 1520, 1617, 1717, 
1820 Pentagonal numbers: n(3n — 1) /2, п > 1 


1, 5, 13, 25, 41, 61, 85, 113, 145, 181, 221, 265, 313, 365, 421, 481, 545, 613, 685, 
761, 841, 925, 1013, 1105, 1201, 1301, 1405, 1513, 1625, 1741, 1861, 1985, 2113, 
2245 Centered square numbers: n? + (n — 1)?, п > 1 


1,5, 14, 30, 55, 91, 140, 204, 285, 385, 506, 650, 819, 1015, 1240, 1496, 1785, 2109, 
2470, 2870, 3311, 3795, 4324, 4900, 5525, 6201, 6930, 7714, 8555, 9455, 10416 
Square pyramidal numbers: n(n + 1)(2n + 1)/6,n > 1 


1, 5, 25, 125, 625, 3125, 15625, 78125, 390625, 1953125, 9765625, 48828125, 
244140625, 1220703125, 6103515625, 30517578125, 152587890625, 762939453125, 
3814697265625 Powers of 5 


1, 5, 52, 1522, 145984, 48464496, 56141454464, 229148550030864, 
3333310786076963968, 174695272746749919580928 

Number of possible relations on n unlabeled points, n > 1 
1, 1, 5, 61, 1385, 50521, 2702765, 199360981, 19391512145, 2404879675441, 
370371 188237525, 69348874393137901, 15514534163557086905, 
4087072509293 123892361 Euler numbers: expansion of sec x 
1, 5, 109, 32297, 2147321017, 9223372023970362989, 
170141183460469231667123699502996689125 

Number of ways to cover an n set, n > 1 
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92. 1, 6, 15, 28, 45, 66, 91, 120, 153, 190, 231, 276, 325, 378, 435, 496, 561, 630, 703, 
780, 861, 946, 1035, 1128, 1225, 1326, 1431, 1540, 1653, 1770, 1891, 2016, 2145, 
2278 Hexagonal numbers: n(2n — 1), п > 1 


93. 1,6, 25, 90, 301, 966, 3025, 9330, 28501, 86526, 261625, 788970, 2375101, 7141686, 
21457825, 64439010, 193448101, 580606446, 1742343625, 5228079450, 
15686335501 Stirling subset numbers: {7}, n > 3 


94. 6,28, 496, 8128, 33550336, 8589869056, 137438691328, 
2305843008139952128, 2658455991569831744654692615953842176 
Perfect numbers: egual to the sum of their proper divisors 
95. 1, 8, 21, 40, 65, 96, 133, 176, 225, 280, 341, 408, 481, 560, 645, 736, 833, 936, 1045, 
1160, 1281, 1408, 1541, 1680, 1825, 1976, 2133, 2296, 2465, 2640, 2821, 3008, 3201 
Octagonal numbers: n(3n — 2), п > 1 
96. 1, 8, 27, 64, 125, 216, 343, 512, 729, 1000, 1331, 1728, 2197, 2744, 3375, 4096, 4913, 
5832, 6859, 8000, 9261, 10648, 12167, 13824, 15625, 17576, 19683, 21952, 24389 
The cubes 
97. 1, —24, 252, —1472, 4830, —6048, —16744, 84480, —113643, —115920, 534612, 
—370944, —577738, 401856, 1217160, 987136, —6905934, 2727432, 
10661420 Ramanujan 7 function 
98. 341, 561, 645, 1105, 1387, 1729, 1905, 2047, 2465, 2701, 2821, 3277, 4033, 4369, 
4371, 4681, 5461, 6601, 7957, 8321, 8481, 8911, 10261, 10585, 11305, 12801, 13741, 
13747 Sarrus numbers: pseudo-primes to base 2 
99. 561, 1105, 1729, 2465, 2821, 6601, 8911, 10585, 15841, 29341, 41041, 46657, 52633, 
62745, 63973, 75361, 101101, 115921, 126217, 162401, 172081, 188461, 252601, 
278545 Carmichael numbers 
100. 1, 744, 196884, 21493760, 864299970, 20245856256, 333202640600, 
4252023300096, 4465699407 1935, 401490886656000, 3176440229784420, 
22567393309593600 Coefficients of the modular function j 


For more information about these sequences and tens of thousands of others, includ- 
ing formulae and references, see “The On-Line Encyclopedia of Integer Sequences", 
published electronically at uww.research.att.com/“njas/seguences/. 


1.3 SERIES AND PRODUCTS 


1.3.1 DEFINITIONS 


If {an is a sequence of numbers or functions, then 
1. Syn = PPM dn = а + ао +... + an is the NY partial sum. 


2. For an in nite series: S = lim Nso SN = уясан an (when the limit exists). 
Then S is called the sum of the series. 
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3. The series is said to converge if the limit exists and diverge if it does not. 
4. If a4, = bng”, where bn is independent of т, then 5 is called a power series. 
5. Ifan = (—1)” |an], then S is called an alternating series. 
6. ІУ а, | converges, then the series converges absolutely. 
7. If Sy converges, but not absolutely, then it converges conditionally. 
EXAMPLES 
1. The harmonic series S = 1+ 5 + 5 +... diverges. Тһе corresponding alternating 
series (called the alternating harmonic series) S = 1—343—:--4(-1)2+... 
converges (conditionally) to log 2. 
2. The harmonic numbers are Н, = Уур, +. The rst few values are (1, 3, 45, 33,...}. 
Asymptotically, Hn ~ Inn + y + 55. 
N М+1 
1-2 
— n =. 1 


1.3.2 GENERAL PROPERTIES 


1. 


Adding or removing a nite number of terms does not affect the convergence 
or divergence of an in nite series. 


The terms of an absolutely convergent series may be rearranged in any manner 
without affecting its value. 


A conditionally convergent series can be made to converge to any value by 
suitably rearranging its terms. 


If the component series are convergent, then 


X (aan + bbn) = aX an + BX bn. 
> 2 (È 2 = 3 Cn Where с, = doby +aiby +: + а,бо. 
n=0 n=0 


n=0 


Summation by parts: let У) an and У` bn converge. Then 


aub. = 5 Sn (bn s bn +1) 


where Sn is the п partial sum of Y^ an. 


A power series may be integrated and differentiated term-by-term within its 
interval of convergence. 


Schwarz inequality: 


X sla < (32s) (УР) 
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10. 


. Holder's inequality: when 1/p + 1/g = 1 and p,q > 1 


Y lanbn| < |5; lanl?) (5 al?) 


Minkowski’s inequality: when p > 1 


(5; nae һр)” < (5 la") 1/p m (S ыру” 


11. Arithmetic mean-geometric mean inequality: If a; > 0 then 
a1 +43 +... + a 
Zur дш 1 
n 
12. Kantorovich inequality: Suppose that O < x4 < zo <... < £n. ЕА; > 0 
and $7 À; = 1 then 
(3o) > 21 <a 
Xi) ©" 
where A = $ (zi + £n) and G = ут. 
EXAMPLES 
1. Let T be the alternating harmonic series S rearranged so that each positive term is 
followed by the next two negative terms. By combining each positive term of T with 
the succeeding negative term, we nd that Туу = 25; м. Hence, T = + log 2. 
2. The series 1-2-1-1-1-1-2-1-2-... diverges, whereas 


Өр AE о ТЕЛЕ ПИТТ ЕКЫ 
3 2 5 7 4 4n—3 4n-1 2n] ^" 


converges to log(2/2). 


1.3.3 CONVERGENCE TESTS 


1. 
2. 


Comparison test: If |an| < bn and У, converges, then 5” a, converges. 


Limit test: If lim, 350 ап # 0, or the limit does not exist, then 5 ау is 
divergent. 


Ratio test: Let р = lim, 300 [TE]. If p < 1, the series converges absolutely. 
If p > 1, the series diverges. 


Cauchy root test: Let o = lim, зо la; |^. If c < 1, the series converges. 
If © > 1, it diverges. 


Integral test: Let |a,| = f(n) with f(x) being monotone decreasing, and 
lim; зоо f(z) = 0. Then [ f(a) dx and У an both converge or both diverge 
for any A > 0. 
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А 
6. Gauss’s test: If | —-| — 1 — Е + a where g > 1 and the sequence {А + 
n 


dn 
1s bounded, then the series is uh convergent if and only if p > 1. 


7. Alternating series test: If |a,,| tends monotonically to 0, then 9-1) | 
converges. 


EXAMPLES 


І. For S = У) пт", p = limnsoo(1 + 2)“ x = т. Hence, using the ratio test, S 
converges for 0 < x < 1 and any value of c. 


2. For 5 = у ы 1 5. с = lim noo (2258) 7" = 5. Тһегеѓоге the series diverges. 
3. For S Sym consider f (x) = 1%, Then 


1 
99 œ d -- fort >1 
1 f(x) ах = / == = {1—1 
1 p diverges fort < 1 
Hence, S converges for t > 1. 


4. The sum V 


ЕЯ Эр converges for s > 1 by the integral test. 


5. Let an = {2а = ep een where c is not 0 or a negative integer. Then 


lan+1/an| = 1 — (с + 1)/n + (с + 1)/n? (1 + 1/n). By Gauss's test, the series 
converges absolutely if and only if c > 0. 


1.3.4 TYPES OF SERIES 
1.3.4.1 Bessel series 


1. Fourier-Bessel series: 2 Qn Jy (GunZ) (Jur is а zero of J,(x)) 
2. Neumann series: ын Qn уат (2) 
3. Kapteyn series: 55 AnJv4n[(v + т) 2] 
оо 
4. Schlómilch series: 5 anJy (nz) 
n=1 


EXAMPLES 
1. КЕ з о Л (2 ) = туту 
2. У Jn(nz) = ууд 1000-2221 
3. 375 (—1)"*%(пг) = 5 for < z «m 
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1.3.4.2 Dirichlet series 


These are series of the form кэрэ “x. They converge for x > zo, where zo is the 
abscissa of convergence. Assuming the limits exist: 


] T 
1. ГУ an diverges, then то = lim log ал Fa 
noo logn 


log lani Fanta +... | 


2. If 3: an converges, then zo = lim 
noo logn 


EXAMPLES 
1. Riemann zeta function: С(х) = У), =, 20-1 


2. Yo, HU = =a ‚ to =1 (p(n) denotes the Möbius function; see Section 2.4.9) 


n=1 ne“ 


з. уу | 20) = (x), 0-1 (а(п) is the number of divisors of n; see page 128) 


n=1 ne“ 


1.3.4.3 Fourier series 
If f(x) satis es certain properties, then (see page 48) 


ау NTE віп RET 
f(x) = > +} (an cos p +bnsin = ) (1.3.1) 


n=1 
1, If f(x) has the Laplace transform F(k) = fj" e~** f(a) dz, then 


= poe 


ва Ї Де? t) —e 
У F(E) cos(kt) = 5 І ЕТ Қа) dz, 


EN ЭР” fs) (1.32) 
300 sin(kt) = 5 І ue 


2. Since the cosine transform of (cosh(x) —cos(t)) ^! with respect to x is т csc(t) 
csch(zy) sinh(r — t)y, we nd that 


O^ ksin(kt) — m sinh(r — t)y 


= k? +y? 2 sinh(zy) 


in(2 1)Ё—1 (242k41 
3. ye, FG = O (=) Pasa (2), for < 2 < 1 


qc cue LED X Bay(z)forü cz < 1 


5. .. : віп((2п--1)та-тлҺ/2 Ti Ex (x) 


(2n41)FTI EU 


6.5 (иа) = ps for |a| < 1 


1—a cos(x) 


7. 3 46” cos(nz) = 122a ose) par for |a| <1 
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1.3.4.4 Hypergeometric series 


The hypergeometric function is 
Q1 аә e 0p» 

Z4 b dy sd, 
where (а), = Г(а + n)/T (a) is the shifted factorial. Any in nite series У A, with 


AÀn441/ Аһ a rational function of n is a hypergeometric series. These include series 
of products and quotients of binomial coef cients. 


EXAMPLES 


n 


ын V (a1) (a2)n - ++ (ap)n 2" 
') > (b) (02), ... (bu) n! (1.3.3) 


—n, а, b . ж. — b) 
2. з ЕЁ» | с, 1+а+ БЕ а, 1) = (c)«(c — a — ba (Saalschutz) 
а, 1+a/2, b, —n |. (а-25,(-Ы, : 
3. Fs ( а/2, 1+a—-b, 14:28:48 1) "аласы шө) 
re ops m _ (3/4)n(5/4)n 
con {езу C+D (ОЛЯ 


1.3.4.5 Power series 


1. The values of r, for which the power series 35 28 anx” converges, form an 
interval (interval of convergence) which may or may not include one or both 
endpoints. 


2. A power series may be integrated and differentiated term-by-term within its 
interval of convergence. 


3. Note that [I ЖУР ane”)! у bng”, where by = ау and bp = 
an + Xp] Бака forn > 2. 
4. Inversion of power series: If s = ЕЛ anz”, then x = px Ans”, where 


Ау = 1/a1, A? = —a2/až, Аз = (2а2 —a1a3)/až, A4 = (5a1a2a3 — af a4 — 
5a3)/at, As = (ба азаа + За?а? + 14a — afas — 21a1a2a3)/a1. 


1.3.4.6 Taylor series 
1. Taylor series in 1 variable: 
2808) 
Қа-а)- 5 P s + RN 


n! 
n=0 
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or 


f(a) = f(a) + /'(а)(ж — a) + ro (c — a)? + ron =й] +... 


or, specializing to a = 0, results in the MacLaurin series 
Д 0 т 0 
f(z) = f(0) + }/'(0)х + P0 + rw ee 
2. Lagrange’s form of the remainder: 


ту 


Ree win € + 0x), forsome 0 « 0 « 1. 


3. Taylor series in 2 variables: 


f(a + x,b +y) = fla,b) + x fs (a, D) +yfy(a, b) + 
3 [17 fea (a, b) + 2ry fayla, b) + y? fy (a b)] +... 


4. Taylor series for vectors: 


N n 
Аа + x) = у ЛӘ в,а) = f(a)+x-Vf(a)t+.... 


n=0 


EXAMPLES 


1. Binomial series: 


When v is a positive integer, this series terminates at n = v. 


TSE DPA frc" for |x| < 1/4 


zt n 
3. deat = 550 Pa (f) sr 


n 


at 
4. EE = 2520 Es (2) 27 


5. узуы TG — zs Jo udu fo dt 251. і" 
= sts [1+ $2? + (1 — 2°) log(1 — x)] for |z| < 1 


6.73 z = Li, (x) (polylogarithm) 


1.3.4.7 Telescoping series 
If limpo F(n) = 0, then У ,[F(n) — F(n + 1)] = F(1). For example, 


со 


1 Se 1 1 1 
(n+1)(n+2) | 2 RE — — 2 (1.3.4) 


n=1 n=1 
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The GWZ algorithm expresses a proposed identity in the form of а telescoping 
series J) [F (n +1,k) — F(n,k)] = 0, then searches for a G(n, k) that satis es 
Fín +1,k) — F(n,k) = G(n,k +1) — G(n,k) and G(n, too) = 0. The search 
assumes that G(n, k) = Rín,k)F(n,k — 1) where R(n, k) is a rational expression 
in n and k. When K is found, the proposed identity is уеп ей. For example, the 
Pfaff-Saalschutz identity has the following proof: 


(k 4- 1)!(n — k)!(c + k)! Е (п +1) (с+ т)! 7? 


(b+ k)(a + А) 
(c—b+n+1)(c—a+n+1)" 


X (a +k)b+k)c—a—b+n—1— k)! c—a+n)(c—b+n)! 
925, 16+ 0) jt )\( ) 


R(n,k) = — 


1.3.4.8 Other types of series 


1. Arithmetic series: 


N 
У(а+ па) = Na+ ZNN 1d. 


n=1 


2. Arithmetic power series: 


ү a — (a «Уы 2(1-25 
Patna" = СС”, еп, (2 #1). 


n=0 


3. Geometric series: 


1 
142445 tat... = —, (|| < 1). 
1-2 
4. Arithmetic-geometric series: 
2 4 а ba: 

a + (a + b)z + (a + 2b)z^ + (a + 3b)a +: = — s. 
1-2 (1-2) 

(| < 1) 


5. Combinatorial sums: 
р) 
(С САМ e CES 


(с) py Me (#1) = (ear) 


e 
(e) p m (mir) 25) = (815) 
d) Dr-o ba: x) (+) = ( Bi n) 


© 2003 by CRC Press LLC 


S S cl ST deem 
(x ШО э Seem 
xL up у storm 24) 


6. Generating functions: 


(a) Bessel functions: p ue Jx(1)2% = exp(i 1221) 
(b) Chebyshev polynomials: У)? T;,(x)z” = 2132). 


(с) Hermite polynomials: 072, Hall yn — exp(2x2 — 22) 


n! 


(d) Laguerre polynomials: У)? у І) (1)2" = (1 — 2) 9—1 exp[ 22] 


(e) Legendre polynomials: 072. Р, (2)27 = Tom for |2| < 1 


7. Multiple series: 


a SS pee i 


1/6)2--(т--1/6)2--(п--1/6)2 
where —oo < l,m,n < oo and they are not all zero 


b Z (m? Fn?) Eum = 40(2)6(2) for —oo < m,n < оо not both zero 


(c) Уто c ren = ve? S) for z > 0 


A 
(d Emn {ттптт d 
2n 
(e) MEC oy Ғог1 < kı << kn < 0 


8. Theta series: 


со 


- оо 
os 5 1 si 2 5 
) en Tit+2niz _ ТА y eC nn)“ [wit 
п--со 


п=— со 


9. Lagrange series: If f(z) is analytic at z = zo, /(20) = wo, and f (20) 4 0, 
then the equation w = f(z) has the unique solution z = F(w). If both 
functions are expanded 


f(z) = fo + fi(z — zo) + falz — 20)? +... 


Е (1.3.5) 
F(w) = Fo + Fi(w — wo) + (ш — wo)? +... 
with Fo = F(wo) = z, then 
11471 Z — 20 j 
eS | Ни ГҮЭЛЛИНИИГЖ 1.3. 
177] 5 UG = s) 52 
22-20 


2 
For example: Ё} = +? Е = =з F, = Mih, Ри? 
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1.3.5 SUMMATION FORMULAE 


1. Euler-MacLaurin summation formula: As n — оо, 


ч ЕЕ {+1 19) (п) 
2.10) 0 + лә дас уге) 1) Bini т! 


where В; is the j ù Bernoulli number and 


m ‘ (2) 
C= „Jim ра + 50) 


Ж a Г Bygatz qup (2) “| 


2. Poisson summation formula: If f is continuous, 


0) + X Oe je fla) dz +2 2 n f(a) cos(21a)de | 


3. Plana’s formula: 
mice) 
Ds) = 310+ [ot OV 


where f is analytic, a is a constant dependent on f, and Б; is the 7 ù Bernoulli 


number. 

EXAMPLES 
1. 2, lo +y+ = l B where ғу is Euler's constant 
gn++ si. wa T y S : 


2. 1425) астаны Ж 
т 
ке 


1.3.6 IMPROVING CONVERGENCE: SHANKS 
TRANSFORMATION 


Let sn be the п? partial sum. The sequences (S(s,)], {S(S(sn))},... often con- 
verge successively more rapidly to the same limit as {5 |, where 


oo 
142^ d (Jacobi) 
= 


2 
Sn+15n—1 — Sn 


Big EE ах, 
(sn) Sn+1 T 5n—1 — 28, 


(1.3.7) 
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EXAMPLE Fors, = V/ 0-1)”, we nd S(sn) = түс for all n. 


1.3.7 SUMMABILITY METHODS 


Unique values can be assigned to divergent series in a variety of ways which preserve 
the values of convergent series. 


oo oo 
1. Abel summation: аһ = lim anr” 
Хивс ч r>1- >, Ж 


со 
2. Cesaro (С, 1)-summation: 5 аһ = Nim. MULA 
—oo 


n=0 
where sn = 355.9 Om: 
EXAMPLES 
()1-1--1-1-..- 5 (іп the sense of Abel summation) 
(b) 1—1+0+1—1+0+1—-:-- = 5 (іп the sense of Cesaro summation) 


1.3.8 OPERATIONS WITH POWER SERIES 
Lety = алх + азл? + аза? +..., and let z = z(y) = bix + box? + ba? +... 


а? + 2a1a2 + аз 
СЕВЕ! 1 
v1+y — 1691 — 14142 + 303 


(1 + y) 1? : -Ža + Залаа = ias 


е? ай + аа» + аз 
log(1 + y) аз — 0103 + аў 
sin y -iaj + аз 


COS y —0102 


1 13 
tang 41 + аз 


1.3.9 MISCELLANEOUS SUMS AND SERIES 
асуы = $(70"* [Ej(n +4 + (CU^E;] 


234 CESS) юн i SEDED 


m+! 
3. De 1 d = my ^ (mcn)! 
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4. 2n 23151408 — 2001 


k—0 k n+ 
De | з, ш 
6. = Oe sech“ sk — тт csch“ s — csch“ x 
7. k20(—1) соз" 28 = Sy, Spo sec TÉ = 0, (k z n/2) 
8. ER "CERE, = 75 [cot(ra) — со((т0)) 


9 ye 1 шах T sinh(ar V2 +sin(arV/2 
` k=0 54-а4 — зат + 2a34/2 cosh(ar V2)—cos(ar v2) 


ЖЕК жетекке 
10. 22851 game 77794 8c 


11. Уо REE = 1 


1 1 
12. X14 ЕК(ЕЗІ)( 42) 


13. o XEHYEPEUHS) ^ 18 


T 2401 
14. лты RE 


со 
1 
15. The series 2, koskor converges to 38.43... so slowly that it re- 


Я 1.1086 : 1 
quires 103-1410" terms to give two-decimal accuracy 


1 
16. The series 2, Исе RÜSEIOERI diverges, but the partial sums exceed 10 only 


after a googolplex of terms have appeared 


17. Ук corr = 21 — In2 + т sech(7V/3/2)] 


1.3.10 INFINITE SERIES 
1.3.10.1 Algebraic functions 


Peg =x" + (2) arty + e p^ cy us 


((+ж®"=1+{[”|х+{(|х%+{[^}х°+..., (22 < 1). 
1 2 3 
= n п+1\ + n+2\ 3 5 
(1+2) ° =1% 1 zd 9 z^cE 3 zc... (1 <1). 
1 1 1 5 
VI+ 51210208 +r? ——х%+..., (х2 < 1). 


2 8 16 128 
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1 3 5 35 
1 -1/2_y_2 217 — Sy? + — 164... ? <1). 
(1 + x) 27 137 16% + Fog” Busty (z^ < 1) 
(1+2) 1 2151242 Fr? +1“ F1+..., (z? < 1). 
(1+2)? —1F2x + 32? F 417 + 5z* ж ба? +..., (22 < 1). 


1.3.10.2 Exponential functions 


-j 1 1 1 
e= ETET 
$ т 12 qn 
е =1+ = + + == +— +, (all real values of т) 
1! 2! n! 
1 x ge 


Ix + 5 TEE TET (x not a positive integer) 
n=1 
(2 — a)“ (z — a)? 
Эр 7259705 
(zlog, а)? NT (z log, а)" 
2! n! 


=e IE 


a“ = 1 + zlog, a + SR 


(all real values of x) 


1.3.10.3 Logarithmic functions 


= 1 м А 1 «АТАЛ 
rc m 
т 2 т n x 
1 2, l 3 
—(z -1)- 5(z - 1) + 5(2 1) ау (2>хт > 0), 
dello 1/z-1\? 1{@-1\° 
=2 = = 4441, > 0). 
eros sl. ч | ша 
(z-a) (z-a? (т—а)% 
=j a нек кала A TEM < 2a). 
oga + 20172 , (0 <= < 2a) 
2 r r 
= g — — + — — — +... — < 1. 
log(1 + 2) = x 1+ Т Р 1<х<1 
log(n + 1) = log( 1) +2 Ын : + : F 
og(n = log(n Е EA 


log(a + x) = loga + 2 


3 5 
x Hn x E x n" 
2а+ 3 \2a+e 5 \2а+х Б |5 
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1.3.10.4 Trigonometric functions 


| x ME. 
Bua =g- zy tyo te (all real values of x). 
ы ку a П real values of 
COS 2 = -Itp gto (all real values of x). 
n 245 (—1)9- 127" (22 кей 1) Вә 
t = ec Оа шл гэг ЭБЭ 1. 
ang —x + 3 ин 15 F F (20) 2 + 
(22 < т?/4, Bn is the n Bernoulli number). 
eotr= M M ET cia aniy.. 
3 45 945 4725 (2n)! 
(£? < т?, В, is the n Bernoulli number). 
ын 1+ 17 " 5 4 P 61 4 » 277 ад " (-1)'E», on n: 
= —+-—2 — r — r ... +| r vus 
2 24 120 8064 (2n)! 


(a? < 17/4, En is the n" Euler number). 


x Tr 814° (= 1)Вэл oni 


1 
eee. aos S O T— NOME xr шк» 


(|z| < т, В, is the n™ Bernoulli number). 


2 4 6 
log sin ж = log x = 15 5855 (a? < 17). 
£? octo xê 174% 
1 E — -- — 2 2 4). 
opor а A 55 ы. 
2? Tat 10007 
log tana = loge + + түр зак +... (22 < 15/4). 
sine 14 g^ 8х1 Ba? 96 | 305" 
К т таш ишш 
z?  4x^ 314° 
COST __ 
e -e(1-5+4- б! +). 
2 3 4 5 
аша. 2 32 92 311 2 2 
е ae ay ШЕП sae bee (x < m^ /4). 
— qa)? {3 
i eed ын ГЕРА. о cosa t .... 
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1.3.10.5 Inverse trigonometric functions 


sin“! x = ке теа дш: т 
Еа РЕГ 2.4.6.7 


Т... 
(x? <1,-% «sin! x < 7). 


тг эасттсПт” 
2:17 7482-4537 Тәте! 


(£? < 1,0 < cos“! x < m). 


3 5 7 
a шж (22 < 1), 
m 1 1 1 1 
z= — — — ammi: > 1), 
2 c j 31% — 545 ш Ta“ e ) 
m 1 1 1 1 
2-———+———— < —1). 
2 m g 323 525 Та? (с ) 
“ЭРЭР ИЕ ЕК ЛЕК ИН (1? <1) 
2 = 2 т 3 5 7 КӨЕ А 
1.3.10.6 Hyperbolic functions 
| ro „т „(2n+1) 
eA a gr igh PI M pq Te 
: or һ sin x 2sin2x 3sin3z 
sinh ат = — sin na а2 +1? 2121213 (|| < т). 
22 dte хб д2" 
ОАТ ign tt Ози 
ЭРТ 2а ium 1 COST " cos 22 cos 82 Ж 04155 
= — sinh ra | — — — = Ў 
т 2а2 а? +12 а +22 а? +32 
1 2 2?n(9?n _ 1) В 
tanh x = x — qe 1150 кане АЕ ae qna (|x| < 1/2), 
= 1 —2e7?” + 30717 —2e78* 4 (Re x > 0), 


1 а а 24° 2?" Bon 
ee ee 20-11. 0 
coth т A ну Oni” + (0 < |z| < т) 
= 1+ 2e77% + 2e71% + 2e78% +... (Re x > 0), 
1 1 1 1 
= —422 |—— + —>— +—— Re x > 0). 
Ge uL {түр EPISC | Retest) 
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1 5 61 Е 
pe 2 бы - uu e е 
sech т 21% + 42 тікі Ее (20)! 


= 2 (672 — e7?” p et 20771 +...) (Re x > 0), 
ы мы уе ле 
T? + 4x2 (3m)? +422 (5r)? + 422 
3 2n—1 
csch x LT Im ee анг ү. (0 < |z| < т), 
= 2 (67% + e7?” p et berie +...) (Re x > 0), 
1 2x 2x 22 


—— Á—— 
x 12-а2 (Qn)? +22 (3n) +r? 


-2 
sinh nu = sinh u [e cosh м)! — 159) (2 cosh u)" ^? 


1! 
+ чыз 0224) u 54 (2coshu)"~° 
1 А n n—2 n(n Es 3) n—4 
coshnu — 2 (9 cosh и) тб coshu)"““ + аг cosh и) 
_ n(n —4)(n — 5) 


3i (2 сови)" 6 +... Ї 


1.3.10.7 Inverse hyperbolic functions 


1 1-3 1515 
Nr PNE HM O ап 1 
sinh x — r 5.37 171.57 eee T (41 < 1), 

1 1 13 1 13-5 1 
belt 5 527 153.4 4x4 * 2.4.6 bat ús] > 


1 1 1.3 1 
cosh”! z = + log(2z) — 2. -— — L— +... (z > 1). 


св 2-5) 15 5008 75+ (| > 1), 


-ЮЕ-545 Ta ы (0« <1). 

sac шакы эы ш и ыл, (0 « z « 1). 
RE LE MM (|2| < 1). 
өшіге рр Gu e (х| > 1). 
gde =e qr uc ee тэг (іш < D. 
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1.3.11 INFINITE PRODUCTS 


For the sequence of complex numbers {ax}, an in nite product is [2 (1 + ax). 
A necessary condition for convergence is that іт „оо 4n = 0. A necessary and 
suf cient condition for convergence is that у m log(1 + ак) converges. Examples: 


ry (1+) 
(a) z! — - 
П 1-2 


oo 
(b) sin z — z | сов эр 
k=1 


(c) sin(a + z) = (sina) Il Č ее; ) 


k—0, 


(d) cos(a + z) = (cos a) П 
3 


в=+1, 


аа! U i 8) шин! ( “ээ гт) 


К=1 k=1 
: r1 z? r1 Az? 
(g) өше. Т] (1+ а) (h) cosh? П (1+ aeos) 


1.3.11.1 Weierstrass theorem 


w? w™ 
Dene E(w,m) = (1—w) exp (+ s et SS), көй = 1,2,... let {bx} 


be a sequence of complex numbers such that |b| — oo. Then the in nite product 


oo 
P(z) = П Е (3 3 is an entire function with zeros at b, and at these points 
k 
k=1 


only. The multiplicity of the root at б,, is equal to the number of indices 7 such that 
b; = bn. 


1.3.12 INFINITE PRODUCTS AND INFINITE SERIES 


1. Тһе Rogers-Ramanujan identities (for a = 0 or a = 1) are 


i oo gk tok 
ДЗ acu ED 
- I (1.3.8) 
Ц Пау — quem Е 
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2. Jacobi’s triple product identity is 
У at = Ща — č) + €711) + 2477). (1.3.9) 
k=—00 j=l 


3. The quintuple product identity is 


со 


_1)k (3k“—k)/2 „3k 1 k 
23 i ыз (1.3.10) 
=|[a-¢ Хізат 4 (1а 791 + 27242771 )(1 + 2242171). 
j=l 


1.4 FOURIER SERIES 


If f(x) is a bounded periodic function of period 2L (that is, f(a + 2D) = f(x)) and 
satis es the Dirichlet conditions, 


1. In any period, f(x) is continuous, except possibly for a nite number of jump 
discontinuities. 
2. In any period f(a) has only a nite number of maxima and minima. 


Then f(a) may be represented by the Fourier series, 


oo 
f(x) = > + Ж (аһ соз = + bp sin —) (1.41) 


where {an } and {b,,} are determined as follows: 


f(a) sin == dz, (1.4.3) 


an = т 
- F Ға) цай. (1.4.2) 
0 
1 L 
-- f(x) cos — dz; 
L 3 
1 a+2L 
283) F(a) sin 777 de forn = 1,2,3,..., 
1 
1, 
1 
1, 


J (x) sin шэн dx, 
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where a is any real number (the second апа third lines of each formula represent 
a = 0 and a = —L respectively). 
The series in Eguation (1.4.1) will converge (in the Cesaro sense) to every point 


f(z*) + Қа”) 
2 


and right hand limits) at every point where f(x) has a jump discontinuity. 


where f(x) is continuous, and to (i.e., the average of the left hand 


1.4.1 SPECIAL CASES 


1. If, in addition to the Dirichlet conditions in Section 1.4, f(a) is an even func- 
tion (i.e., f(x) = f(—x)), then the Fourier series becomes 


oo 
, Q0 NTE 
= +} nco- (144) 
n=1 
That is, every bn = 0. In this case, the {an } may be determined from 
9 pL 
-1] F(z) cos E dz п =0,1,2,.... (1.4.5) 


If, in addition to the above requirements, f(x) = —f(L — x), then ад will be 
zero for all even values of n. In this case the expansion becomes 


si 
-È ат ИР EO Lae — мэ (14.6) 


2. If, in addition to the Dirichlet conditions in Section 1.4, f (x) is an odd function 
(i.e., f(x) = —f(—«)), then the Fourier series becomes 


= алта 
- 2,5 (14.7) 
That is, every ау = 0. In this case, ће {b,,} may be determined from 
9 гї 
-2/ F(a) sin 777 dz п =1,2,3,.... (1.4.8) 
0 


If, in addition to the above requirements, f(x) = f(L — x), then b, will be 
zero for all even values of n. In this case the expansion becomes 


si 
-X | o ae — ша (14.9) 


The series in Eguation (1.4.6) and Eguation (1.4.9) are known as odd harmonic 
series, since only the odd harmonics appear. Similar rules may be stated for even 
harmonic series, but when a series appears in even harmonic form, it means that 27, 
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has not been taken to be the smallest period of f(a). Since any integral multiple of 
a period is also a period, series obtained in this way will also work, but, in general, 
computation is simpli ed if 2L is taken as the least period. 

Writing the trigonometric functions in terms of complex exponentials, we obtain 
the complex form of the Fourier series known as the complex Fourier series or as the 
exponential Fourier series. It is represented by 


oo 
Тола x cnet? (14.10) 
n=—0o 
пт : 
where wn = T for n = 0, +1, £2,... and ће 4с, + are determined from 
ye 
— — wn? dr. 1.4.11 
Cn = oF [, Т(а)е ах ( ) 


The set of coef cien ts {cpn is often referred to as the Fourier spectrum. 


1.4.2 ALTERNATE FORMS 


The Fourier series in Equation (1.4.1) may be represented in the alternate forms: 


1. When ф„ = tan! (Cas /b4), аһ = Cn sin bn, bn = —Cn COS фи, 


and сь = ууа? + 62, then 


f(z) = 2+ V c, sin (= + да) | (1.4.12) 


2. When ф„ = tan! (an Бл), Gn = Cn sin dn, bn = Cn cos Фи, 


and сь = үа + 62, then 


fs 2 + 22% сов (— + én) | (14.13) 


1.4.8 USEFUL SERIES 


4 "r 1 317 1 571 
1 = — [sin — + — sin — + — sin — +... L 
(a) = E T шан T + = віп T + | (0<a<L) 


2L тл 1 2171x 1 Зла 
b = — [sin — — — sin — + — sin — +... —L L 
(b) т x ШЕ 5 sin — + зіп 7 + | (-L < x < L) 
4L та 1 Зла 1 572 
© 2212-55 [0s T + 5 oF + Goose +... (0 « x « L) 
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8111 1 L 2 L 3 353 ES 
т^. Ane T 4 . nx 
cua ues (5 -&) Ек | (0 « x « L) 
(e) жож. о тк ми. 
T; 7 т BD. dB err quc T 
(—L « x « L) 
T 1 1 1 
eese 
© 2 3^5 7 
т? 1 1 1 1 1 1 
т? 1 1 1 1 1 1 1 
07-16 986693 ++ gt) 


1.4.4 EXPANSIONS OF BASIC PERIODIC FUNCTIONS 


fx) 


A 
c 2 (—1)* nuc ба sja 
уаш жу up атлы уа j | | 
n=1 0 
L 2L x 
fo) 
4 1 3 
o пт i 
(b) f(x) = x 5 — sin T, я 
n=1,3,5,.. L 2L x 
at 
fo) 
2 — (—1)" n NTE ! тэн © +— 
(с) іа) = =); - (cos 75 — 1) sin T : ЭЭ 
n=1 L 2L х 
! —» c Ж- 
fo) 
2< тт віп (птс/21/) NTE cb 9—4 
(d) f(x) = = sin — ———— sin —— 3L/2 
L 2 2 ттс/21, L 1 E + lI» 
U —>l c 14— 
CRI SARUM LP PL a2.) 
NE: mn 4 2L 
Дх) 
PE 
TLIA 
| М4 1, Jar x 
21 
а 
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(0) Қа)- 


(g) f(x) 


(h) f(x) 


G) f(x) = 


0) f(z) = 


(k) f(x) = 


(D f(a) = 


(m) f(x) = 


Дх) 


1 TX NTE 
mx denný — S 1 
2 m 2, n s L " | 
n=1 у 
2L х 
fix) 
1 4 1 -— nox 1 
(17 9; 
2 т ЕС E 0 i rj i гүл р: 
itä 2 Gl A nux c 
— [C = mr x а = zr 
2 “50:52:18 к= conna 1505 L ( 21) 
fo) 
| [ee 
0 4 + > 
d 2L X 
1 4 1 nac 2 
= — cos cos —— а = эт 
2 72(1— 2a) 3, та onta cos -7 (a= a) 
n=1,3,5,... 
fo) 
| с 
ШЕГІ 1 2L - c/2 2L T 
2 & (-1)""" sin тта NTE E 
ENT П | лылы (a = 5) 
T n тт(1-а) 
n=1 
Дх) 
— (/2|4- 
1 
0 Ť 2-2 
Е —»] c2 lee 
2 «<, (—1)" 14+ (-1)* ттт Р 
= 1 а = зт 
з - Talla? jme sin L ( 57) 
fœ) 
| >| 12 — 
1 
21-42 , 
| с/2 Т. 2L х 
1 ы 02 |е 
fœ) 
2 (-1)""" . nrg І 
Е 5 sin E 2L 
T L 0 —> 
n=1 | | x 
-1 
Дх) 
8 [ane s . NTE i 
z жин sin : | 31/2 
nal ,3,5, 1/2 L 2L 5 


© 2003 Ьу СКС Press LLC 


fœ) 
А 


үгз 
© 
М.У 
“қ 
= 
8 
A, 
| 
[4v] 
[4v] 
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iM 
E 
u 
B 
ЕЕ 
u 
B 
3 
t3 
8 
E T 
2 
сі 
a 
- 
LD 
5 
N 
x 
-ү 


sin or T = 21/0 


| 
TIO 21/0 t 


1.5 COMPLEX ANALYSIS 


1.5.1 DEFINITIONS 


A complex number z has the form z = x + iy where x and y are real numbers, and 
i = V —1, the number 2 is sometimes called the imaginary unit. We write r = Re z 
and y — Im z. The number z is called the real part of z and y is called the imaginary 
part of z. This form is also called the Cartesian form of the complex number. 
Complex numbers can also be written in polar form, 2 = те”, where r, called 


the modulus, is given by r = |z| = 4/2? + y?, and 0 is called the argument: 0 = 
args = tan! = (when x > 0). The geometric relationship between Cartesian and 
polar forms is shown below 
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The complex conjugate of z, denoted Z, is de ned as 7= x — iy = re~*®. Note 
that |z| = |Z|, arg Z = — аге z, and |z| = Vzz. In addition, 7 = z, 21 F z» = 
21 + Zo, and 2122 = 2129. 


1.5.2 OPERATIONS ON COMPLEX NUMBERS 


1. Addition and subtraction: 
21 Ж 29 = (21 Td) + (тә + iy») = (21 + тә) + i(y1 + y»). 


2. Multiplication: 


2129 = (21 + йу) (29 + tye) = (2129 — ууз) + (2142 + 2941) = Tiree 
| 1221 = |2125], arg(z1 za) = arg zı + arg z2 = 9, + бэ. 
3. Division: 


а _ 2122 (vir guys) тал — ті») _ Т1 аваз) 


> 2 2 
29 2929 15 y T2 
21 [21| 21 
— uM arg | — | шаг 21 — arg z2 = 01 — 05. 
29 22| 29 
4. Powers: 
z^ = pei"? — т"(созп@ + isin né) DeMoivre’s Theorem. 
5. Roots: 


2 


, 


1/n = үй/тү(04284)/п — An (cos 9 + 2kr ТЕТЕ 9 ын 
n n 


fork = 0,1,...,n — 1. The principal root has —r < 0 < r and k = 0. 


1.5.3 FUNCTIONS OF A COMPLEX VARIABLE 


A complex function 
ш = f(z) = (х,у) + iv(z,y) = |ш|е'®, 


where z = x + ty, associates one or more values of the complex dependent variable 
ш with each value of the complex independent variable z for those values of z іп a 
given domain. 

A function f(z) is said to be analytic (or holomorphic) at a point zo if f(z) is 
de ned in each point z of a disc with positive radius R around 20, h is any complex 
number with |h| < R, and the limit of [ f(zo+h)—f(zo)]/h exists and is independent 
of the mode in which h tends to zero. This limiting value is the derivative of f(z) 
at zo denoted Бу / (20). A function is called analytic in a connected domain if it is 
analytic at every point in that domain. 

A function is called entire if it is analytic in C. 

Liouville’s theorem: A bounded entire function is constant. 


© 2003 by CRC Press LLC 


4(01--02) . 


EXAMPLES 


1. f(z) = z" is analytic everywhere when n is a non-negative integer. If n is a negative 
integer, then f(z) is analytic except at the origin. 


2. f(z) = zis nowhere analytic. 


3. f(z) = е? is analytic everywhere. 


1.5.4 CAUCHY-RIEMANN EQUATIONS 


A necessary and suf cient condition for f(z) = u(x, у) + iv(z, y) to be analytic is 
that it satis es the Cauchy—Riemann equations, 


Qu ду Ou Ov 
Me NES б da 1.5.1 
дт ду? ЯН ду Ox Con 


1.5.5 CAUCHY INTEGRAL THEOREM 


If f(z) is analytic at all points within and on a simple closed curve С, then 


| Ге dz = 0. (1.5.2) 
с 


1.5.6 CAUCHY INTEGRAL FORMULA 


If f(z) is analytic inside and on a simple closed contour С and if z is interior to С, 
then 


1 (2) 
=== dz. 1.5.3 
C Did acc (1.5.3) 
Moreover, since the derivatives f'(zo), f" (zo), ... of all orders exist, then 
! 
(n) аа 110) 2 4 1.5.4 
f (го) Әлі. Ї! (z 29)" e ( “re ) 


1.5.7 TAYLOR SERIES EXPANSIONS 


If f(z) is analytic inside of and on a circle С of radius т centered at the point 20, 
then a unique and uniformly convergent series expansion exists in powers of (z — z 9) 
of the form 


f(2) = 5 Gn(z — 20)", |z—2ze| «T, 20 oo, (1.5.5) 
n=0 
where 7 i f) 
EE V ce. у. emt „ 
an =" 09-33 А (c 552 
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If M (r) is an upper bound of | f(z)| on С, then 
M (r) 
pn 


1 
|аһ| = zi ()| € (Cauchy's inequality). (1.5.7) 


If the series is truncated with the term a4 (z — zo)", the remainder R,,(z) is given by 


(ear (o. 
AOE 1 = is: (1.5.8) 


2т? (s — zo) 


and 
[z — 20 rM (т) 


|Rn(2)| < ( - 521 (1.5.9) 
o] 


1.5.8 LAURENT SERIES EXPANSIONS 


If f(z) is analytic inside the annulus between the concentric circles C1 and С» cen- 
tered at zo with radii rı and rə (rı < r2), respectively, then a unique series expansion 
exists in terms of positive and negative powers of z — 20 of the following form: 


oo oo 
f(z) = bn (z — 20)" + An(z — 20)" 
2, 2, (1.5.10) 
СУ лы ЖЫ ЭШЕТ + а1(2 — zo) + as(z — 20)? + 
90779 0 1 0 2 0 ... 
with (here С is a contour between C and C) 
1 
=з] Sas mS ONL 2.44 
i e о (1.5.11) 
by = эп | foe gg) dss. п=1,2,3,.... 
Equation (1.5.10) is often written in the form 
oo 
f(2) = 5 €n(z — 20)” for rı < |z — 20| < r2 (1.5.12) 
n-—-—oo 
with 
1 
Mag rene ee ee (1.5.13) 


п Oni с (z — 20)"+! 


1.5.9 ZEROS AND SINGULARITIES 


The points z for which f(z) = 0 are called zeros of f(z). A function f(z) which is 
analytic at zg has a zero of order m there, where m is a positive integer, if and only 
if the rst m coef cients dg,G1,... „Am —1 in the Taylor expansion at zo vanish. 

A singular point or singularity of the function f(z) is any point at which f(z) 
is not analytic. An isolated singularity of f(z) at zo may be classi ed in one of three 
ways: 
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1. А removable singularity if and only if all coef cien ts b,, in the Laurent series 
expansion of f(z) at zo vanish. This implies that f(z) can be analytically 
extended to го. 


2. A pole of order m if and only if (z — z0)"" f(z), but not (z — 20)""—! f(z), is 
analytic at 20 (i.e., if and only if bm A 0 and 0 = by, 41 = by po =... in the 
Laurent series expansion of f(z) at zo). Eguivalently, f (z) has a pole of order 
m if 1/ f(z) is analytic at 20 and has a zero of order m there. 


3. An isolated essential singularity if and only if the Laurent series expansion of 
f(z) at zo has an in nite number of terms involving negative powers of z — 20. 


Theorems: 


Riemann removable singularity theorem Suppose that a func- 
tion f is analytic and bounded in some deleted neighborhood 0 < |z — 
20| < € of a point 20. If f is not analytic at zo, then it has a removable 
singularity there. 


Casorati-Weierstrass theorem Suppose that zo is an essential 
singularity of a function f, and let w be an arbitrary complex number. 
Then, for any е > 0, the inequality | f(z) — w| < eis satisi ed at some 
point z in each deleted neighborhood 0 < |z — zo| < ô of zo. 


1.5.10 RESIDUES 


Given a point 20 where f(z) is either analytic or has an isolated singularity, the 
residue of f(z) is the coef c ient of (z — 20) "іп the Laurent series expansion of 


f(z) at zo, or 
Res(zo) = b = 70 fle (1.5.14) 
2лї 


If f(z) is either analytic or has a removable singularity at zo, then b, = 0 there. If 
20 1s a pole of order m, then 


E да 


= = —— 
1 (m — 1)! dzm-1 


[(z — zo)" f (2)] (1.5.15) 


2—20 


For every simple closed contour C enclosing at most a nite number of singularities 
21,22,..., 2 Of a function analytic in a neighborhood of C, 


1 f(z) dz = 2тї 5 Бев(2,), (1.5.16) 
c 


where Res(z;.) is the residue of f(z) at zp. 
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1.5.11 THE ARGUMENT PRINCIPLE 


Let f(z) be analytic on a simple closed curve C with no zeros on C and analytic 
everywhere inside С except possibly at a nite number of poles. Let Ac arg f(z) 
denote the change in the argument of f(z) (that is, nal value — initial value) as z 
transverses the curve once in the positive sense. Then 


—Acars f(z /-5:/,50 Pe 


where N is number of zeros of f(z) inside С, and Р is the number of poles inside С. 
The zeros and poles are counted according to their multiplicities. 


(1.5.17) 


1.5.12 TRANSFORMATIONS AND MAPPINGS 


A function ш = f(z) = u(z) + iv(z) maps points of the z-plane into corresponding 
points of the w-plane. At every point z such that f(z) is analytic and f (z) # 0, 
the mapping is conformal, i.e., the angle between two curves in the z-plane through 
such a point is equal in magnitude and sense to the angle between the corresponding 
curves in the w-plane. A table giving real and imaginary parts, zeros, and singu- 
larities for frequently used functions of a complex variable and a table illustrating a 
number of special transformations of interest are at the end of this section. 

A function is said to be simple in a domain D if it is analytic in D and assumes 
no value more than once in D. Riemann’s mapping theorem states: 


If D is a simply-connected domain in the complex z plane, which is nei- 
ther the z plane nor the extended z plane, then there is a simple function 
f(z) such that w = f(z) maps D onto the disc | | < 1. 

1.5.12.1 Bilinear transformations 


sh az 
The bilinear transformation is de ne d by w = 


b 
па T where a, b, c, and d are com- 


с 
plex numbers and ad Z bc. It is also known as the linear fractional transformation. 
The bilinear transformation is de ned for all z £ —d/c. The bilinear transformation 


is conformal and maps circles and lines onto circles and lines. 


А 3 ежен —dw + b Жэ 28 
The inverse transformation is given by 2 = ———— — ,, which is also a bilinear 
cw — a 


transformation. Note that w # a/c. 
The cross ratio of four distinct complex numbers 2, (for k = 1,2, 3,4) is given 
by 
(21 — 22)(23 — 24) 
(21 — 24) (23 — 22) 
If any of the z, "s is complex in nity , the cross ratio is rede ned so that the quotient 
of the two terms on the right containing z , is equal to 1. Under the bilinear transfor- 
mation, the cross ratio of four points is invariant: (w1, W2, W3, W4) = (21, 22, 23, 24). 
The Mobius transformation is special case of the bilinear transformation; it is 
de ned by w(z) = 4x less than 1. It 
maps the unit disk onto itself. 


(21, 22, 23, 24) = 
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x,y) = Im w(z, y) Zeros (and order m) Singularities (and order m) 


Pole (m = 1) at z = oo 
т? — у? Pole (т = 2) at z = oo 
т 
KEET Pole (m = 1) at z = 0 
ey? 
(x? + у?)? 
1 2-а 
z — (a + ib) (x — a)? + (y — 5)? 
a, breal 


Wow 
to 


[ен 


Pole (m = 2) at z = 0 


xR 
N 


Pole (m = 1) at z = a + ib 


1/2 
22 
+ (=F) ------ Branch point (m = 1) atz = 0 


2 Branch point (m = 1) at z = оо 
e” cosy e” sin y None Essential singularity at z — oo 
sin x cosh y cos z sinh y z= kr,m=1 Essential singularity at z 
(k = 0, +1, +2,...) 
cos x cosh y — sin x sinh y z= (К+ 1/2), m = 1 Essential singularity at z 
(k = 0, +1, +2,...) 
sinh z cos y cosh z sin y 2 = Еті, т = 1 Essential singularity at z 
(k = 0, +1, +2,...) 
cosh x cos y sinh z sin y z= (k+ 1/2)тї,т =1 Essential singularity at z 
(k = 0, +1, +2,...) 
sin 2x sinh 2y 


A "No 2-0 = Еп, т = 1 Essential singularity at z = 
cos 2x + cosh 2y cos 2x + cosh 2y 2 hen Ta S С Бо 


(k = 0,+1,+2,... Poles (т = 1) at z = (k +1/2)7 
(k -0,2Е1:5Е2....) 
sinh 2x sin 2y 


Ж r dd REP ъа Seen = kri, т = 1 Essential singularity at z = 
cosh 2x + сов 2y cosh 2x + cos 2y с к eer gto хуссан 


(k = 0, +1, +2,... Poles (m = 1) at z = (k + 1/2)ri 
(k =0,+1,+2,...) 


-1 2 Lok z=l1,m=1 Branch points at z = 0, z = оо 


y 
(k = 0, +1, +2,...) 


2 
zlog(z? + y?) tan 


1.5.12.2 Table of transformations 
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1.5.12.3 Table of conformal mappings 


In the following functions 2 = x + iy and w = u + iv = pe“. 


w = 22; A B' on the 


3. bol 2k? 
arabola p = —————. 
P p l4 coso 
4. - w21/z. 
y vx 
С = 
5. й zs w = 1/2. 
с. 
6 w = е?. 
x 1 u 
(2 В А Е Е DEO В A 


© 2003 Ьу СКС Press LLC 


ш = sin z. 


ш = sin z. 


w = sin z; BCD: y =k, B'C'D' 
is on the ellipse 


(с) T (xxx) нь 


2-1 

2-1 
1—7 

w= - : 
14+ z 
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z—a 1+ a2. + V/(1 — 22)(1 — 22) 
вае === аага. 
az — 1 Tı + 22 


1— 2122 + (1 — 22)(1 — 22) 
Ron ЕГА оаа ыу; 


X1 — Va 
(a > 1 and Ro > 1 when —1 < x» < 11 < 1). 


15. 


— 4-0, 
С az—1' 
1129 —1 (жї — 1)(23 — 1) 


Ro — 
Iı — Va 
(zo <a < ri and0 < Ro < 1 when 1 < x < 2). 


v 


17. w = z +1/2. 
с w = z + 1/2; B'C'D' is on the 
еШрве 


| " ( ku | ( kv | 
—- - m- —— +l1—— — 1. 
р Е F A'B k? +1 k? —1 
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—1 
w = log ага, АВС 18 оп Ше 
241 


20. . A 
ү | circle x? + y? — 2y cot k = 1. 


2-1 


w = log D relationship 


2- 
between centers and radii: centers 
of circles at 2 = coth cn, radii are 


csch c4, n = 1,2. 


= + log2(1—k) + 


in—klog(2+1)—(1—k) log(2—1): 
21 = 2k — 1. 


= К] 
w 08 1 


w = tan?(z/2). 


w = coth(z/2). 


u w = logcoth(z/2). 
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26. w = mi + z — log z. 


2+1)"/2 —1 


зал фе l 
28. k Ж. 1-1" 

of 224 

t=(=5) : 
29 h to 1/2 -1 
. ш = = [е — 1)!/? + cosh“! z]. 

ш = cosh“! ага - 
30. т 

1 a [(k + 10) 2 — 2k 

; cosh | T- | 
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1.6 INTERVAL ANALYSIS 


1. An interval x is a subset of the real line: x = [z, 3] = {z E R | z < z € 2}. 
2. A thin interval is a real number: x is thin if z = x 
3. mid(z) = 2+2 5. |z| = mag(z) = max |z| 
T zem 
4. rad(z) = 557 6. (z) = mig(z) = min |z| 
ZET 


1.6.1 INTERVAL ARITHMETIC RULES 


[min(zy, zy, zy, TY), max(zy, zy, TY, TY) 


EXAMPLES 
1. [1,2] + [—2,1] = [—1,3] 3. [1,2] « [—2,1] = [—4, 2] 
2. [1,2] 528 [1,2] = [-1, 1] 4. р, 21/1, 2 = [5,2] 


1.6.2 INTERVAL ARITHMETIC PROPERTIES 


sub-distributivity | z(y + z) C ху - xz (equality holds if x is thin) 
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1.7 REAL ANALYSIS 


1.7.1 RELATIONS 


For two sets A and B, the product A x B is the set of all ordered pairs (a, b) where 
a is in А and b is in B. Any subset of the product A x В is called a relation. A 
relation R on a product A x A is called an equivalence relation if the following three 
properties hold: 


1. Reflexive: (a, a) is in R for every ain A. 
2. Symmetric: If (a,b) is in R, then (b, a) is in R. 
3. Transitive: If (a, b) and (b, c) are in R, then (a, с) is in R. 


When R is an equivalence relation then the equivalence class of an element a in A 
is the set of all b in A such that (а, b) is in R. 


1. If |A| = n, there are 25“ relations on A. 


2. If |A| = n, the number of equivalence relations on A is given by the Bell 
number Bn. 


EXAMPLE The set of rational numbers has an equivalence relation “=” de ned by the 
requirement that an ordered pair (7, 2) belongs in the relation if and only if ad = bc. 
The equivalence class of 2 is the set (2, 2, $,..., —> -2,...). 


1.7.2 FUNCTIONS (MAPPINGS) 


A relation f on a set X x Y is a function (or mapping) from X into Y if (a, y) and 
(2, z) in the relation implies that y = z, and each x € X has ay € Y such that 
(x, y) is in the relation. The last condition means that there is a unique pair in f 
whose rst element is т. We write f(x) = y to mean that (2, y) is in the relation f, 
and emphasize the idea of mapping by the notation f: X > Y. The domain of f is 
the set X. The range of a function f is a set containing all the y for which there is a 
pair (x, y) in the relation. The image of a set A in the domain of a function f is the 
set of y in Y such that y — f(x) for some x in A. The notation for the image of А 
under f is f [A]. The inverse image of a set В in the range of a function f is the set 
of all тіп X such that f(x) = y for some y in B. The notation is f ^! [B]. 

A function f is one-to-one (or univalent, or injective) if f(x 1) = f (x2) implies 
21 = тә. A function f: X — Y is onto (or surjective) if for every y in Y there is 
some x in X such that f(x) = y. A function is bijective if it is both one-to-one and 
onto. 
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EXAMPLES 
1. Га) = e”, as a mapping from R to IR, is one-to-one because e”! = e”? implies 

21 = хә (by taking the natural logarithm). It is not onto because —1 is not the value of 

e? for any z in IR. 

3 


2. g(x) = x“ —r, as a mapping from R to R, is onto because every real number is attained 
as a value of g(x), for some т. It is not one-to-one because g(—1) = g(0) = g(1). 


3. h(x) = x?, as a mapping from R to IR, is bijective. 


For an injective function f mapping X into У, there is an inverse function f ^! 
mapping the range of f into X which is de ned by: f-!(y) = z if and only if 
f(x) = y. 

EXAMPLE Тһе function f(x) = e” mapping R into IR^ (the set of positive reals) is 
bijective. Its inverse is f7 (c) = ln(x) which maps К into IR. 

For functions f: X > Y and g: Y — Z, with the range of f contained in the 

domain of g, the composition (g o f): X — Z isa function de ne d by (go f)(x) = 

gCf (x)) for all x in the domain of f. 


1. Note that g o f may not be the same as f o g. For example, for f(x) = x + 1, 
and g(x) = 2x, we have (go f)(x) = g(f(x)) = 2f(a) = 2(x +1) = 2x 4 2. 
However (f o g)(x) = f(g(x)) = g(a) - 12 22 +1. 


2. For every function f and its inverse f ^!, we have (f o /71)(2) = т, for all 
x in the domain of f~}, and (f^! o f)(x) = z for all x in the domain of f. 
(Note that the inverse function, f 71, does not mean p. 


1.7.83 SETS OF REAL NUMBERS 


A sequence is the range of a function having the natural numbers as its domain. It 
can be denoted by {z,, | n is a natural number} or simply {£n +. For a chosen natural 
number N, a finite sequence is the range of a function having natural numbers less 
than N as its domain. Sets А and В are in a one-to-one correspondence if there is 
a bijective function from A into B. Two sets А and В have the same cardinality if 
there is a one-to-one correspondence between them. A set which is equivalent to the 
set of natural numbers is denumerable (or countably infinite). A set which is empty 
or is equivalent to a nite sequence is finite (or finite countable). 


EXAMPLES The set of letters in the English alphabet is nite. The set of rational num- 
bers is denumerable. The set of real numbers is uncountable. 


1.7.3.1 Axioms of order 


1. There is a subset P (positive numbers) of R for which x + y and xy are in P 
for every z and y in P. 


2. Exactly one of the following conditions can be satis ed by a number x in IR 
(trichotomy): x € P, — € P,orx = 0. 
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1.7.3.2 Definitions 


A number b is an upper (or lower) bound of a subset S in IR if x < b (or x > b) for 
every x in S. A number c is a least upper bound (lub, supremum, or sup) of a subset 
S in R if cis an upper bound of S and b > c for every upper bound b of S. A number 
cis a greatest lower bound (glb, infimum, or inf) if c is a lower bound of S and c > b 
for every lower bound b of S. 


1.7.3.3 Completeness (or least upper bound) axiom 


If a non-empty set of real numbers has an upper bound, then it has a least upper 
bound. 


1.7.3.4 Characterization of the real numbers 


The set of real numbers is the smallest complete ordered eld that contains the ratio- 
nals. Alternatively, the properties of a eld, the order properties, and the least upper 
bound axiom characterize the set of real numbers. The least upper bound axiom 
distinguishes the set of real numbers from other ordered elds. 

Archimedean property of R: For every real number x, there is an integer N such 
that x < N. For every pair of real numbers x and y with x < y, there is a rational 
number r such that x < r < y. This is sometimes stated: The set of rational numbers 
is dense in R. 


1.7.3.5 Definition of infinity 


The extension of IR by оо is accomplished by including the symbols +00 and —oo 
with the following de nition s (for all r € R) 


1. forallzinR: -oo < z < oo 6. ifr» Ü0thenz:(—oo) = —oo 
2. forall zin R: x + 00 = oo 7. 00 + 00 — 00 
3. Жоға! тіп IR: т 00 = 700 8 —00— 00 = —oo 
4. forall xin R: — = — = 0 9. œ ю= ою 
: Эх РЭН 10 —00 + (—00) = oo 
5 ifx > (then x - оо = oo : ОО 52 


1.7.3.6 Inequalities among real numbers 


The expression a > b means that a — bis a positive real number. 


1, Ifa < band b < c then a < c. 
2. If a < bthena +c < b + c for any real number с. 


if c > 0 then ac < bc 
3. Ifa < band 4 , 
if c « 0 then ac » bc 


4. If a < band c < d then a +c< b + d. 
. IfO0< a< band0 < c< dthen ac < bd. 


ab > 0 
6. Ifa < band then 
ab « 0 


сл 


alIHalH 
Sole Sle 
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1.7.4 TOPOLOGICAL SPACE 


A topology on a set X 1s a collection T of subsets of X (called open sets) having the 
following properties: 


1. The empty set and X are in T. 
2. The union of elements in an arbitrary subcollection of T' is in Т. 
3. The intersection of elements in a nite subcollection of Т is in Т. 


The complement of an open set is a closed set. А set is compact if every open 
cover has a nite subcover. The set X together with a topology T is a topological 
space. 


1.7.4.4 Notes 


1. A subset E of X is closed if and only if E contains all its limit points. 
2. The union of nitely many closed sets is closed. 

3. The intersection of an arbitrary collection of closed sets is closed. 

4. The image of a compact set under a continuous function is compact. 


1.7.5 METRIC SPACE 


A metric (or distance function) on a set Е is a function p: E x E — R that satis es 
the following conditions: 


1. Positive definiteness: p(x,y) > 0 for all x, y in E, and p(x, y) = Oif and only 
if = у. 

2. Symmetry: p(x,y) = ply, х) for all x, y in E. 

3. Triangle inequality: pla, у) < pla, z) + lz, y) for all x, y, z in E. 


EXAMPLE Тһе set of real numbers with distance de ned by d(x, у) = |x — y| is a metric 
space. 


A 6 neighborhood of a point x in a metric space F is the set of all y in E such that 
d(x,y) < 6. For example, a 6 neighborhood of x in R is the interval centered at x 
with radius б, (ж — 6,2 + 6). In a metric space the topology is generated by the 6 
neighborhoods. 


1. A subset G of R is open if, for every x in G, there is a 6 neighborhood of x 
which is a subset of G. For example, intervals (a,b), (а,оо), (-оо,0) are open 
in R. 


2. A number z is a limit point (or a point of closure, or an accumulation point) 
of a set F if, for every ô > 0, there is a point y in F, with y Z т, such that 
|© —y| < 0. 


3. A subset F of R is closed if it contains all of its limit points. For example, 
intervals [а, b], (—oo, b], and (а, оо) are closed in R. 
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4. A subset F is dense in R if every element of R is a limit point of F. 


5. A metric space is separable if it contains a denumerable dense set. For ex- 
ample, IR is separable because the subset of rationals is a denumerable dense 
set. 


6. Theorems: 


Bolzano-Weierstrass theorem Any bounded in nite set of 
real numbers has a limit point in R. 


Heine—Borel theorem A subset of R is compact if and only if it 
is closed and bounded. 


1.7.6 CONVERGENCE IN R WITH METRIC |z — yl 
1.7.6.1 Limit of a sequence 


A number L is a limit point of a sequence (x) if, for every e > 0, there is a natural 
number N such that |z,, — L| < e forall n > N. If it exists, a limit of a sequence 
is unique. A sequence is said to converge if it has a limit. A number L is a cluster 
point of a sequence {£n } if, for every € > 0 and every index N, there is an n > N 
such that |2 — L| < є. 


EXAMPLE The limit of a sequence is a cluster point, as in {+}, which converges to 0. 
However, cluster points are not necessarily limits, as in {(—1)”}, which has cluster 
points +1 and —1 but no limit. 

Let {£n Бе a sequence. A number L is the limit superior (limsup) if, for every 

€ > 0, there is a natural number N such that r, > L — e for in nitely many n > N, 

апат, > L + є for only nitely many terms. An equivalent de nitio n of the limit 

superior is given by 
lim sup £n = inf sup xx. (1.7.1) 
N g2N 
The limit inferior (liminf) is de ned in a similar way by 


lim inf £n = eup sol Zh. (1.7.2) 
For example, the sequence {xp} with zn = 1+ (-1)* + x has lim sup £n = 2, 
and lim inf z,, = 0. 


Theorem Every bounded sequence {zp} in R has a lim sup and 
a lim inf. In addition, if lim sup z, = liminf gn, then the sequence 
converges to their common value. 


A sequence {£n} is a Cauchy sequence if, for any € > 0, there exists a positive 
integer N such that |x, — £m| < € for every n > N and m > Л. 


Theorem A sequence fx, + in R converges if and only if it is a 
Cauchy sequence. 


A metric space in which every Cauchy sequence converges to a point in the space is 
called complete. For example, R with the metric d(x, y) = |2 — y| is complete. 
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1.7.6.2 Limit of a function 


A number L is a limit of a function f as x approaches a number a if, for every є > 0, 
there is a ô > 0 such that | f(x) — L| < e for all x with 0 < |x — a| < à. This 
is represented by the notation lim „ +a f(x) = Г. The symbol ос is the limit of a 
function f as т approaches a number a if, for every positive number M, there is 
аб > 0 such that f(x) > М for all x with 0 < |z — a| < ô. The notation is 
и, за f (©) = oo. A number L is a limit of a function f as x approaches оо if, for 
every е > 0, there is a positive number M such that | f(a) — L| < e for all z > M, 
this is written lim, +50 f(x) = L. The number L is said to be the limit at infinity. 


EXAMPLES lim3r—1=5, lim domo imien. 
as 


1.7.6.3 Limit of a sequence of functions 


A sequence of functions 4 f, (x)? is said to converge pointwise to the function f (x) 
on a set E if for every є > 0 and z € E there is a positive integer N such that 
|/(ж) — fu(a)| < є for every n > N. A sequence of functions {f,,(a)} is said to 
converge uniformly to the function f оп a set E if, for every € > 0, there exists a 
positive integer № such that | f(x) — fn(x)| < € for all z in E and n > N. 

Note that these formulations of convergence are not equivalent. For example, 
the functions f(x) = x" on the interval (0, 1] converge pointwise to the function 
f(x) = 0for0 € т <1, f(1) = 1. They do not converge uniformly because, for 
є = 1/2, there is по N such that |f, (z) — f(x)| < 1/2 for all x in [0,1] and every 
n > М. 

A function f is Lipschitz if there exists k > 0 in R such that |/ (£) — f(y)| € 
k|a — y| for all апа y in its domain. The function is a contraction if 0 < k < 1. 


Fixed point or contraction mapping theorem Let E be a 
complete metric space. If the function f: E — E is a contraction, then 
there is a unique point x in E such that f(x) = т. The point x is called 
a fixed point of f. 


EXAMPLE Newton’s method for nding a zero of f(x) = (x + 1)? — 2 on the interval 


[0,1] produces ті = g(an) with the contraction g(x) = £ — 5 + 1: This has 
the unique x ed point V2 — 1 in [0,1]. 


1.7.7 CONTINUITY IN R WITH METRIC |z — y| 


A function /: R > R is continuous at a point a if f is de ned at a and 
lim f(x) = f(a). (1.7.3) 
ria 


The function f is continuous on a set E if it is continuous at every point of E. A 
function f is uniformly continuous on а set E if, for every є > 0, there exists ad > 0 
such that |f (x) — f(y)| < є for every x and y in E with |x — y| < 6. A sequence 
{fn(x)} of continuous functions on the interval [a, b] is equicontinuous if, for every 
€ > 0, there exists a б > 0 such that | f(x) — fn(y)| < € for every n and for all x 
and y in [a, b] with |2 — y| < ô. 
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1. A function can be continuous without being uniformly continuous. For exam- 
ple, the function g(x) = 1 1s continuous but not uniformly continuous on the 
open interval (0, 1). 


2. A collection of continuous functions can be bounded on a closed interval with- 
out having a uniformly convergent sub-sequence. For example, the continuous 
functions /,(2) = TE are each bounded by 1 in the closed inter- 
val [0, 1] and for every x there is the limit: limp. /л(2) = 0. However, 
fn (2) = 1 for every т, so that no sub-seguence can converge uniformly to 0 
everywhere on [0, 1]. This seguence is not eguicontinuous. 


Theorems: 
Theorem Let { fn(x)} be a sequence of functions mapping R into 
R which converges uniformly to a function f. If each fn(x) is continu- 
ous at a point a, then f(x) is also continuous at a. 


Theorem If a function f is continuous on a closed bounded set Е, 
then it is uniformly continuous on Ё. 


Ascoli-Arzela theorem Let K be a compact set in R. If { f,(a)} 
is uniformly bounded and equicontinuous on K, then ff „ (2) } contains 
a uniformly convergent sub-sequence on K. 


Weierstrass polynomial approximation theorem Let K be 
a compact set in IR. If f is a continuous function on K then there exists 
a sequence of polynomials that converges uniformly to f on K. 


1.7.8 BANACH SPACE 


A norm on a vector space E with scalar eld R is a function || - || from E into R that 
satis es the following conditions: 


1. Positive definiteness: ||x|| > 0 for all x in E, and ||v|| = 0 if and only if 
2 = 0. 
2. Scalar homogeneity: For every = in E and a in R, ||ах|| = |а| |||. 


3. Triangle inequality: | + y|| < ||x|| + ||y|| for all x, y in E. 


Every norm ||. || gives rise to a metric p by de ning: p(z,y) = ||x — yll. 


EXAMPLES 


1. IR with absolute value as the norm has the metric p(x, y) = |x — yl. 


2. R x R (denoted IR?) with the Euclidean norm ||(2, y)|| = \/a? + y? has the metric 
p((x1, 91), (22, y2)) = y (z1 — 22)? + (11-12). 


A Banach space is a complete normed space. 
A widely studied example of a Banach space is the (vector) space of measurable 


functions f on (0, b] for which fi Жа) dx < oo with 1 < p < оо. This is denoted 
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by Lyla, b] or simply Lp. The space of essentially bounded measurable functions on 
[а, 0] is denoted by Loola, b]. 


1/p 
The Ly norm for 0 < p < oo is de ned Бу ||/|, = tb (а) 2 ‚ Тһе 
La norm is de ned by 


Ха). (1.7.4) 


Л = ess sup 
a<a<b 


where 


ess sup |f(z)| =inf{M|m{t: f(t) > M) = 0). (1.7.5) 
a<a<b 


Let {fn(x)} be a sequence of functions in Lp (with 1 € p < oo) and f be some 
function in Гр. We say that {fn} converges in the mean of order р (or simply in 
Lp-norm) to f if lim оо || fn — fll, = 0. 


Riesz-Fischer theorem The L, spaces are complete. 


1.7.8.1 Inequalities 


1. Minkowski ineguality If f and g are in Lp with 1 < p < oo, then 
llf + gll S 171, + Ilgllp- That is, 


b 1/р b 1/p b 1/p 
(/ БЭ «(| m) «(f s) for 1 < p < oo, 


(1.7.6) 
esssup |f + g| < esssup |Ң + ess sup |g]. 


2. Hólder inequality If p and q are non-negative extended real numbers such 
that 1/p + 1/g = 1 and f € Lp and g € Ly, then [|f gll, < (1711, 1911. That 


1S 
b b 1/p b 1/q 
| was (f m) | | 2 forl<p<oo, (177) 


b b 
f г < (esssup |/) f lgl. (1.78) 


3. Schwartz (or Cauchy-Schwartz) inequality If f and g are in Dg, then 
[fall < ПА 19115. This is the special case of Hólder's inequality with p = 


4-2. 
4. Arithmetic mean-geometric mean inequality If A, and Gn are the arith- 
metic and geometric means of the set of positive numbers {a1,a2,...,@n} 


then А, > Gy. That is 


a1 +023 +... + аһ 
n 


> (a1 a2 va аһ)!/" 
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5. Carleman’s inequality If А, and С аге the arithmetic and geometric 
means of the set of positive numbers {a1, a2,..., an + then 


Y С, < пеАь. 
rel 


1.7.9 HILBERT SPACE 


An inner product on a vector space E with scalar eld C (complex numbers) is a 
function from E x E into C that satis es the following conditions: 


1. (z, z) > 0, and (2,2) = 0 if and only if z = 0. 
2. (a +y,z) = (8,2) + (0, z) 
3. (со,у) = c (x,y) 
4. (x,y) = (y, z) 
Every inner product (x, y) gives rise to a norm | 2 | by de ning ||x|| = (2, x) ын 


A Hilbert space is a complete inner pa T - шоо studied Hilbert 
space is Ľa[a, b] with the inner product (7, g) = f? f(t) 
Two functions f and g in Г [а, b] are orthogonal : | ? = 0. A set of Lə 


functions { Фу, } is orthogonal if f? Omn = О for m Z n. The set is orthonormal 
if, in addition, each member has norm 1. That is, ||¢,||, = 1. For example, the 
functions {sin nz) are mutually orthogonal on (-т,т). The functions { ae form 
an orthonormal set оп (-т,т). 

Let ($4) be an orthonormal set in Lə and f be in Lə. The numbers с, = 
ЇР fón dx are the generalized Fourier coefficients of f with respect to {¢,,}, and the 
series 7.1 саф, (x) is called the generalized Fourier series of f with respect to 
{Фл}. 

For a function f in Lə, the mean square error of approximating f by the sum 
PES ал, Фу, 18 = f? |/(ж) — PC AM An On (ж)|? dr. An orthonormal set ($4) is 
complete if the only measurable function f that is orthogonal to every $ is zero. 
That is, f = 0 а.е. (In the context of elementary measure theory, two measurable 
functions f and g are equivalent if they are equal except on a set of measure zero. 
They аге said to be equal almost everywhere. This is denoted by f = g a.e.) 

Besseľs inequality: For a function f in Lə having generalized Fourier coef - 

: b 
cients 416615 317-4 |е | « Т |f (x) |? ат. 


Theorems: 


Riesz—Fischer theorem Let ($4) be an orthonormal set in Lə 
and let {cn } be constants such that Уу |c2 | converges. Then a unique 
function f in Lə exists such that the с, are the Fourier coef cien ts of f 
with respect to {ġn } and $77 , cnn converges in the mean (or order 


2) to f. 


© 2003 by СКС Press LLC 


Тһеогет The generalized Fourier series of f in La converges іп 
the mean (of order 2) to f. 


b со 
Тһеогет Parsevaľ s identity holds: / |f(x)|? dz = »3 [с]. 
@ n=1 


Theorem The mean square error of approximating f by the se- 
. oo . 22.28 . . 
ries 22223 аһфһ is minimum when all coef cien ts а, are the Fourier 

coef c ients of f with respect to [$4]. 


EXAMPLE Suppose that the series 42 + $77 (|а|? + |bn|”) converges. Then the 


trigonometric series $ 4-377 , йн cos nz + bn sin nz) is the Fourier series of some 
function in Гә. 


1.7.10 ASYMPTOTIC RELATIONSHIPS 


Asymptotic relationships are indicated by the symbols О, О, ©, о, and ~. 


1. 


The symbol O (pronounced “big-oh"): f(x) € O(g(x)) as 2 > Xo if a pos- 
itive constant C exists such that |f (x)| < C |g(x)| for ай x suf ciently close 
to zo. Note that O(g(x)) is a class of functions. Sometimes the statement 
Ка) € O(g(z)) is written (imprecisely) as f = O(g). 


. The symbol Q : f(x) € O(g(z)) as x > zo if a positive constant C exists 
such that |g(z)| € C |f(x)| for all x suf ciently close to zo. 

. The symbol © : f(x) € Ө(9(2)) as x — xo if positive constants сі and сэ 
exist such that cig(x) < f(x) € cog(x) for ай x suf ciently close to zo. This 
is equivalent to: f(x) = O(g(x)) and g(x) = O(f(x)). The symbol z is 


often used for O (i.e., fa ) & 9(2)). 


. The symbol o (pronounced “Tittle-oh"): f(a) € o(g(x)) as x > zo if, given 


any u > 0, we have |f(x)| < ulg(1)| for all x suf ciently close to zo. 


. The symbol ~ (pronounced “asymptotic to”): f(x) ~ (g(x)) as x > xo if 


f(a) = g(x) [1+ o(1)] as 2 > zo. 


. Two functions, f(x) and g(x), are asymptotically equivalent as x — xo if 


f (z)/g(x) vlas 2 > то. 


. A sequence of functions, {g;,(2)}, forms an asymptotic series at zo if 


gii (0) = о(дк(®)) as © > то. 


. Given a function f(x) and an asymptotic series [gi (x)] at xo, the formal 


series JO у 4x91 (x), where the {ag} are given constants, is an asymptotic 
expansion of f (x) if f (x) Ур о akgk(£) = O(gn(x)) as 2 > то for every n; 
this is expressed as f(x) ~ > у-у agi (x). Partial sums of this formal series 
are called asymptotic approximations to f(x). This formal series need not 
converge. 
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Think of О being an upper bound on a function, 2 being a lower bound, and © 
being both an upper and lower bound. For example: sin € O(a) as x — 0,logn € 
o(n) as n — oo, and n? € О(п? + n?) as n — оо. 

The statements: n? = о(п?), n? = 0(2"), 2” = o(n!), and n! = o(n™) as 
n — oo сап be illustrated as follows. If a computer can perform 10? operations 
per second, and a procedure takes f(n) operations, then the following table indicates 
approximately how long it will take a computer to perform the procedure, for various 
/ (n) functions and values of n. 


107“ sec 1077 sec 1076 sec 1075 sec 1074 sec 
107“ sec 107? sec 0.3 sec 10 sec 41 minutes 
1076 sec 1077 sec 2 weeks 10"! centuries 107 centuries 
10139 10596 centuries 


1073 sec 77 years 1046 centuries centuries 


10 вес 10" centuries 1066 centuries 10!“! centuries 10725 centuries 


1.8 GENERALIZED FUNCTIONS 


1.8.1 DELTA FUNCTION 
0 270 


со 2-0 


Dirac’s delta function is a distribution de ned by 6(x) = | ‚ and is nor- 


malized so that [ б (2) dx = 1. Properties include (assuming that f(x) is contin- 
uous): 


1. [© f(w)6(@ — a) dz = f(a). 
2/9 f(2) GA da = (1) S. 


3. zô(x), as a distribution, equals zero. 


4. ó(ax) = Ta] (2 т) when a Z 0. 

5. (a? — а?) = d-[ó(x + a) + d(x — a)]. 

6. ó(z) = эт + + У), cos 222 (Fourier series). 

7. (a -€)= ФУ sin — ша sin "72 for 0 < € < L (Fourier sine series). 
8. d(x) = + f^. e'^* dk (Fourier transform). 
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9. (0 = p) =p Ју ЕЈ. (Ер) Im (kp!) dk. 


Sequences of functions {¢,,} that approximate the delta function as n — oo аге 
known as delta sequences. 


EXAMPLES 
1. on(a) = 2 iz УЕ 0 |x| > 1/n 
-т?а? " n/2 || < 1/n 


The delta function ô(x — x“) = ó(z1 — x1)ô (12 — x5)6(a3 — x4) in terms of the 
coordinates (£1, 2, з), related to (z1, £2, £3), via the Jacobian J (xj, £;), is written 


M 
Ха» 8) 


For example, in spherical polar coordinates 


б(х—х') = ó(& — &)8(& — &)d(3 — &). (1.8.1) 


(х= x") = E ó(r — r')5(@ — V )Jô (cos 9 — cost). (1.8.2) 


The solutions to differential equations involving delta functions are called Green’s 
functions (see pages 463 and 471). 


1.8.2 OTHER GENERALIZED FUNCTIONS 


The Heaviside function, or step function, is de ned as 


ig 0 «<0 
d= f wal, um (1.8.3) 


Sometimes H (0) is stated to be 1/2. This function has the representations: 
1. H(z) = 2+2 aa 1 sin 222 
2 T 7 Lun=odd n L 


2. Н(а jE 


The related signum function gives the sign of its argument: 


-1 Ил <0 
sen(x) = 2H (x) — 1 = | EUR (1.8.4) 
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142+---+n= 2 


— A A A A A AL. 


ее 
ее 
ее 
ее 
ее 
ее 
OJO 
ее 


192+ “ал 1 nnd = шэн 


| 1434-4 Qn-D = L(Qn)?=n? 
—Jan Richards 4 
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Geometric Series 


—Rick Mabry 


Addition Formulae for the Sine 
and Cosine 


sinxsiny 


&utsxsoo 


ФА 


KSODXUIS 


LN 


COSXCOSy 


sin(x + y) = sinxcosy + cosxsiny 


cos(x + y) = cosxcosy — sinxsiny 
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Geometric Series 


1 


2 
l+r+r + 1 
1 l-r 


—Benjamin G. Klein 
and Irl C. Bivens 


The Distance Between a Point and a Line 


y 


(a,ma + с) 


ma +c—b 


у=тх+с 


4. [ma + c — b| 


1 414m? 


—R. L. Eisenman 


The Mediant Property 
The Arithmetic Mean-Geometric Mean 


Inequality 4.25 gy Bel „с 


< 
b d b b+d а 


a,b > 0— “? > Jab 


d 
a a 
— а >a b > Ь d 
— Charles D. Gallant —Richard A. Gibbs 


Reprinted from “Proofs Without Words: Exercises in Visual Thinking”, by 
Roger B. Nelsen. Copyright 1993 by The Mathematical Association of America, 
pages: 3, 40, 49, 60, 70, 72, 115, 120. 

Reprinted from “Proofs Without Words II: More Exercises in Visual Thinking”, 
by Roger B. Nelsen. Copyright 2000 by The Mathematical Association of America, 
pages 46, 111. 


2.2 ELEMENTARY ALGEBRA 


2.2.1 BASIC ALGEBRA 
2.2.1.1 Algebraic eguations 


A polynomial equation in one variable has the form f(x) = 0 where f(x) is а 
polynomial of degree n 


1 


f(x) = аһа" + an cix" +++ Hair + ао (2.2.1) 

and an £ 0. 
A complex number z is a root of the polynomial f(x) if f(z) = 0. A complex 
number z is a root of multiplicity k if f(z) = f'(z) = f"(z) 2... = fY (z) = 0, 


but f) (2) Z 0. A root of multiplicity 1 is called a simple root. A root of multiplicity 
2 is called a double root, and a root of multiplicity 3 is called a triple root. 
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2.2.1.2 Roots of polynomials 
1. Fundamental theorem of algebra 


A polynomial equation of degree n has exactly n complex roots, where a dou- 
ble root is counted twice, a triple root three times, and so on. If the n roots of 
the polynomial f(a) are 21, 22, ..., Zn (where a double root is listed twice, a 
triple root three times, and so on), then the polynomial can be written as 


f(a) = an(x — z)(z — 24)... (x — zn). (2.2.2) 


2. If the coef cie nts of the polynomial, fag,a1,...,Gn +, are real numbers, then 
the polynomial will always have an even number of complex roots occurring 
in pairs. That is, if z is a complex root, then so is Z. If the polynomial has an 
odd degree and the coef cients are real, then it must have at least one real root. 


3. The coef cients of the polynomial may be expressed as symmetric functions 
of the roots. For example, the elementary symmetric functions (s , +, and their 
values for a polynomial of degree n (known as Viete’s formulae), are: 


QAn-1 
81 = 21 c Za-b tn = -—, 
an 
аһ-2 
$9 = 2129 + 2123 + 2923 +: = žižj = —, 
an 


i»j (2.2.3) 


Sn = #1#з2з...#һ = (1) ©, 
dn 


where s; is the sum of (51 products, each product combining k factors without 
repetition. 


4. The discriminant of the polynomial is de ned by [Į]; (ži — 2;)?, where the 
ordering of the roots is irrelevant. The discriminant can always be written as a 
polynomial combination of ao, a1, ..., Gn, divided by ap. 


2 
(a) For the quadratic equation ax“ + bx + c = 0 the discriminant is pac 


(b) For the cubic equation ax? + bx? + cx + d = 0 the discriminant is 


b? c — 4b?d — Дас? + 18abcd — 27a?d? 


a“ 


5. The number of roots of a polynomial in modular arithmetic is dif cult to pre- 
dict. For example 


(а) y“ +y + 1 = 0 has one root modulo 51: у = 37 
(b) y^ + y +2 = 0 has no roots modulo 51 
(c) y^ +y + 3 = 0 has six roots modulo 51: y = (15,27, 30, 32, 44,471 
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2.2.1.3 Resultants 


Let f(x) = anz” + as 2177714 --+a17 + ад and g(x) = bz" 4b 42771 + 
+612 + bo, where a4 Z О and bm Z 0. The resultant of f and g is the determinant 
of the (m +n) x (m + n) matrix 


An — Qn—1 I TO ао 0 ... 0 
0 An аһ-1 a1 ао 0 
0 „Ала 0 а, GAn-1 m ал ao 
deb iecore Sa Pea Rd (2.2.4) 
0 0 bm by bo 
0 Due Omi we bo 0 ... 0 
bm bm—1 ie: bo 0 sy wea 00 


The resultant of f (z) and g(x) is 0 if and only if f(x) and g(x) һауе a common root. 
Hence, the resultant of f(a) and f'(x) is zero if and only if f (x) has a multiple root. 
EXAMPLES 


1. If f(z) = x? + 2x + 3 and g(z; a) = 4a? + 5x? + 6x + (7 + a), then the resultant 
of f(x) and g(x; a) 18 


123 0 0 
01 2 3 0 

46610 0 1 2 3 | =(164+a) 
045 6 T+a 
4 5 6 Tta 0 


Note that g(x, —16) = (4x — 3)(z? + 2x + 3) = (4x — 3) f (x). 
2. The resultant of ax + b and cx + d is da — bc. 
3. The resultant of (r + a)“ and (x + b)? is (b — a)”. 


2.2.1.4 Algebraic identities 
(a+b)? = а? + 2ab + b“. 
(a + Б)? = a? + 3a?b + ЗаЬ? + 5°. 
(a + b)“ = a“ + 4ab + ба?Ь? + 4ab? + b“. 


(a +b)" = (i) a^(3-b)"-^ — where (5) - TERT] 


k 
a? + b“ = (a + bi)(a — bi). 
a^ + bf = (а? + V2ab + 0) (а? — V2ab + b). 
a? — b? — (a — b)(a + b). 
a? — b = (a — b)(a? + ab + b>). 
"у — (a — bý(a!"—) + a^72b +: + ав" 2 + 6071, 
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(а + 5+ c) = а? + + с? + 2ab + 2ac + 2bc. 
(a + b -- c)? = а? +b + с? + 3(a?b + ab? + а?с+ ас? + bc + bc?) + Gabc. 
a^ +b” = (a + b) (a^^! + (—b)a" + (—Ь)?%а”"—% +++ + (-b)""!) modd 


2.2.1.5 Laws of exponents 


Assuming all quantities are real, a and b positive, and no denominators are zero, then 


x 


а?а? = att”, za ан, (ab)“ = ast“, 
a 
1 а\ aë 
O_ 4; at nit A M MAN 
a. —lifa 40, go (5 SETE 


жт- 
© 
8 
Му 
© 
| 
© 
8 
© 
© 
ај 
lI 
© 
Е 
а 8 
s 
Сун 
lI 
8 > 
ЕЕ 
= 
s 


2.2.1.6 Proportion 


а с a b a a+b _ ctd а—Ь _ с-а a—b _ c—d 
If% = 5, then $ = 7, ad = be, bs jug үз = <-4 and 1 тела" 
If i = 5, where а, b, c, and d are all positive numbers and a is the largest of the 


four numbers, then a +d > b + c. 


2.2.2 PROGRESSIONS 
2.2.2.1 Arithmetic progression 


An arithmetic progression is a seguence of numbers such that the difference of any 
two consecutive numbers is constant. If the sequence is а1,42,...а,, Where a, 1.1 — 
a, = d, then aj = а + (k — 1)d and 


n 
a bag rn = 5 (21 + (1 — Da), (2.2.5) 
In particular, the arithmetic progression 1,2,...,n has the sum n(n + 1)/2. (See 


page 22.) 


2.2.2.2 Geometric progression 


A geometric progression is a sequence of numbers such that the ratio of any two con- 
secutive numbers is constant. If the sequence is а1,42,...,а,, where aj41/a; = т, 
then aj = art. 


l-r” 
ала r£l 


(2.2.6) 
пал т = 1. 


semen e| 


If |r| < 1, then the in nite geometric series a1(1 +r +r? +r? +---) converges to 
a For ехапріе,1--25142----2. 


ppt 
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2.2.2.3 Меап< 


1. The arithmetic mean of a and bis given by ан, More generally, the arithmetic 
mean оҒаі,аз,...,а, is given by (aj +a2 +++++4y)/n. 

2. The geometric mean of a and b is given by уар. More generally, the geometric 
mean of ал, а2,...,аһ is given by W/a103...an. The geometric mean of n 
positive numbers is less than the corresponding arithmetic mean, unless all of 


the numbers are equal. 


1 2ab 
3. The harmonic mean of a and b is given by ———7 = а 
ala t3) a+b 


a 


If A, С, and Н represent the arithmetic, geometric, and harmonic means of a and b, 
then AH = С. 


2.2.3 DEMOIVRE'S THEOREM 


A complex number a + bi can be written in the form те, where т? = a? + b? and 
tan 0 = b/a. Because е? = cos + і ѕіп 0, 
(a + bi)” = r"(cos n8 + i sinn6), 
с 2km 2. 2km 
V1 = cos —— + isin ——, k —0,1,...,n— 1. (2.2.7) 


2 1 2 1 
Ae = o REF DT х CEEA 
TL TL 


2.2.4 PARTIAL FRACTIONS 


The technique of partial fractions allows a quotient of two polynomials to be written 
as a sum of simpler terms. 
Let f(x) and g(a) be polynomials and let the fraction be : c . If the degree 


of f(x) is greater than the degree of g(a) then divide f(x) by g(a) to produce a 
quotient q(x) and a remainder r(x), where the degree of r(x) is less than the degree 


of g(x). That is, : ы. = gx) + un . Therefore, assume that the fraction has the form 
r(x) 


FOE where the degree of the numerator is less than the degree of the denominator. 


The techniques used to nd the partial fraction decomposition of ша depend on the 
factorization of g(x). 


2.2.4.1 Single linear factor 
Suppose that g(x) = (x — a)h(x), where h(a) Z 0. Then 
r(x A s(x 
m AC KP T эн (2.2.8) 
where s(x) can be computed and the number A is given by r(a)/h(a). For example 
(here r(x) = 2a, g(x) = z? — 1 = (x — 1)(z +1), h(x) = x +1, anda = 1): 
22 1 1 
PET т—1 eT 


(2.2.9) 
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2.2.4.2 Repeated linear factor 
Suppose that g(x) = (x — a)^h(z), where h(a) # 0. Then 
r(z) A A» En s(x) 
асан ed it nexa Dh (2.2.10) 


for a computable s(x) where 


3 

— 
© 

хи 


A, = Қа) 
_ 4 (ғ) 
Ak- = 5 V) (2.2.11) 
Ar = di? (55) "n 
Ak-j = E 17 (25) a—a 


2.2.4.3 Single quadratic factor 
Suppose that g(x) = (x? + ba + c)h(z), where b? — Ас < 0 (so that x? + bx + c 
does not factor into real linear factors) and h(x) is relatively prime to x? + bz + c 
(that is h(a) and x? + bx + c have no factors in common). Then 

r(x) Ar + В s(x) 


g(z)  12+br+c tú Қа): (2.2.12) 


In order to determine A and В, multiply the equation by g(x) so that there are no 
denominators remaining, and substitute any two values for x, yielding two equations 
for A and B. 

When A and B are both real, if after multiplying the equation by g(x) a root of 
x? + bx + cis substituted for т, then the values of A and В can be inferred from this 
single complex equation by equating real and imaginary parts. (Since z? + ba + c 
divides g(x), there are no zeros in the denominator.) This technique can also be used 
for repeated quadratic factors (below). 


2.2.4.4 Repeated quadratic factor 

Suppose that g(a) = (x? + ba + c)*h(a), where b? — 4c < 0 (so that r“ + br + c 
does not factor into real linear factors) and h(a) is relatively prime to x? + br + c. 
Then 


r(x) Az + Bı Az + Bo Asx + Вз 
g(x) £? +bat+e  (12+be +0)? (122 +br +c) 
Ара + В, s(x) 


(22 + bx + c)“ = h(a)’ 
In order to determine А; and B;, multiply the equation by g(x) so that there are no 


denominators remaining, and substitute any 2k values for т, yielding 2k equations 
for A; and B;. 
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2.3 POLYNOMIALS 


All polynomials of degree 2, 3, or 4 are solvable by radicals. That is, their roots 
can be written in terms of a nite number of algebraic operations (+, —, x, and +) 
and root-taking ( v. ). While some polynomials of higher degree can be solved by 
radicals (e.g., r)“ = 1 is easy to solve), the general polynomial of degree 5 or higher 
cannot be solved by radicals. However, general polynomials of degree 5 and higher 
can be solved using hypergeometric functions. 


2.31 QUADRATIC POLYNOMIALS 


The solution of the equation ar“ + bx + с = 0, where a 4 0, is given by 


A —b + b? — Дас 


2; (2.3.1) 


The discriminant of the quadratic equation is (b? — 4ас)/а?. Suppose that a, b, and 
c are all real. If the discriminant is negative, then the two roots are complex numbers 
which are conjugate. If the discriminant is positive, then the two roots are unequal 
real numbers. If the discriminant is 0, then the two roots are equal. 


2.3.2 CUBIC POLYNOMIALS 


To solve the equation ar? + bx? + cx + d = 0, where a # 0, begin by making the 
3ac—b? 
9a? 


substitution y = £+ i. That gives the equation y? --3py --q — 0, where p — 
and g — 25 —9abe лага, The discriminant of this polynomial is 4p? + g“. 

The solutions of y? + 3py + g = 0 are given by Va + J/B, e$. Yates WB, 
and e$ Va + е2 УЙ, where 


= 24 4р3 od ZAJACE AD? 
A aes у and g= кек тай, (2.3.2) 


2 


Suppose that p and q are real numbers. If the discriminant is positive, then one 
root is real, and two are complex conjugates. If the discriminant is 0, then there are 
three real roots, of which at least two are equal. If the discriminant is negative, then 
there are three unequal real roots. 


2.3.2.1 Trigonometric solution of cubic polynomials 


In the event that the roots of the polynomial y? + 3py + g = 0 are all real, meaning 
that q? + 4p? < 0, then the expressions above involve complex numbers. In that case 
one can also express the solution in terms of trigonometric functions. De ne r and 0 
by 


r= /—p? and 0 = cos)! x (2.3.3) 
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Then the three roots are given by 


9 
24r cos =, 2%/r cos 


0 +27 тал 


апа 2 4/r cos (2.3.4) 


2.3.3 QUARTIC POLYNOMIALS 


To solve the equation d + br? + cx? + dr ка е = 0, where a Z 0, start with the 
substitution y = x + үс. This gives y^ + py? + qy +r = 0, where p = mc 
а= b saber Sa d ee хы 1баё c+ 2860:6- —35° —64a5 bd 

The ре resolvent of this polynomial is de ned as t? — pt? —4rt+ (Apr —q°) = 
0. If u is a root of the cubic resolvent (see previous section), then the solutions of the 


original quartic are given by 2 = y — i. where y is a solution of: 


2 q ues 


2.3.4 QUARTIC CURVES 


Any quartic curve of the form y? = (x — a)(x — 8)(a — y)(x — ô) сап be written as 


(>) -(-222) (1-12) (1-2=*) (2.3.6) 


and hence it is cubic in the coordinates X = T and Y — T 
y? = 1—2“ is the cubic Y? = 4X?—6X?--4X —1 in the coordinates X = 1/(1—2) 
and Y = y/(1 — x)“. 


2.3.5 GUINTIC POLYNOMIALS 


Some quintic equations are solvable by radicals. If the function f(x) = r» 4- az +b 
(with a and 6 rational) is irreducible, then f(a) = 0 is solvable by radicals if, and 
only if, numbers е, c, and е exist (with € = +1, c > 0, and e Z 0) such that 


(3—4 —4e5(11 2 
_ 5e (3 — 4ec) erie е?(11є + e 


2.3.7 
2+1 c? +1 қы) 


In this case, the roots are given by 2 = e (wiu + wus + wus + wus) for 
j = 0,1, 2,3,4, where w is a fth root of unity (w = exp (2л4/5)) and 


0103 = 0204 = 0201 = 0202 
2)? U2 = p]: из = "pz ye ил = "p? } ° 

Ui VD+VD — «У, 09 

v3 = -VD+\/D+evD, v4 = 


D- +1. 


U1 


sá 
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EXAMPLE The quintic f(x) = а? + 15x + 12 has the values е = —1, с = 4/3, and 
e — 1. Hence the unigue real root is given by 


"m (= + i A (= 5 a 


125 125 
225 + 72/10 2 ү (225— 72/10 \ 5 
125 125 


2.3.6 TSCHIRNHAUS' TRANSFORMATION 


The n degree polynomial equation 


ах" + an 1171 +- + a,x + a9 = 0 (2.3.8) 
can be transformed to one with up to three fewer terms, 
z? E bs gz 4 ++ biz + b =0 (2.3.9) 
by making a transformation of the form 
zj = yT] + PBE? + Maj d yin + no (2.3.10) 
for j = 1,...,n where the fy, } can be computed, in terms of radicals, from the (а). 


Hence, a general quintic polynomial can be transformed to the form z“ + az +b = 0. 


2.3.7 POLYNOMIAL NORMS 


n 
The polynomial P(x) = 5 аул? has the norms: 


j=0 
27 | 49 n 
ЇР -| Peis. [Р| = х [aj]. (2.3.11) 
bu es pee do ^ 2 к 
ІРІ» = (/ ЇР (є) | x) [Pls = 2 lasl? ЖЕСІН; 
ІРІ = тах [P(z)| (Phas max ІЛЕ (2.3.13) 


For the double bar norms, Р is considered as a function on the unit circle; for the 
single bar norms, P 1s identi ed with its coef cients. These norms are comparable: 


[Plo «ЇР: <ІР»-ІРІ» < |Р <1РЬ <Р. (344 


2.3.8 CYCLOTOMIC POLYNOMIALS 


The 4® cyclotomic polynomial, Ф а(х), is 


d 
Ф ()-1| (-£&)22*9 +... (2.3.15) 
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where the £j = e?7**/¢ are the primitive d™ roots of unity 


= gb] 
Ф,(2) = Le 551] if p is prime 
k=0 
цэн — 
2" —1=][Ф@) (2.3.16) 
dln 
2n 
т —1 Пар, 9a(2) 
27-1- = | ?»40) 
n __ 
2 1 Паһ 9a(2) aim 
where n = 2*-!m and m is odd. 
n cyclotomic polynomial of degree n 
1 —1+x 
2.- Дор? 
3 lta+—?= ші 
4 1+1 
5 1+1+2? +17 tet = ©} 
6 1—1+1“ 
7 1+a+2? +25 +2 +15 +26 = ші 
8 1-а4 
9 1-czz) az 
10 1—x+1? — x + 2! 
11 14242429 Ra ba! ta? Hal Ha? a + 010 =o 
2—1 
12 1-2? +x“ 
13 221 
2—1 
1441-2422 — 1 + x) r’ +28 
15 1—x+13 — x) + 3 — x" + 78 
16 1428 
17. 4 
17: 
18 1-2 +26 
19 
19: #——1 
2—1 
20 1-а? +7! — 26 +28 
21 dpa дз r? — r +r — grl pg? 
22 1- 2+2? — r? +2) — а? +29 — 27 +19 — 79 Hr 
23 27 
2—1 
24 1-2 +28 
25 Pg? 10:15 2% 
26 1- gtr? – 13 +1 — a» +08 – a +08 – x» +19 — 1]! + 12 


27 1+1x9+1!8 

98:11:48 66: 84004008 
29 1 

29 За 

30 1+x—1 — x) — a +r’ +r’ 
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2.3.9 OTHER POLYNOMIAL PROPERTIES 


n 
1. Jensen's inequality: For the polynomial P(x) = b aj x), with ао 20 


j—0 
27 

| ЧӨ 
| log | Р (e'^)| — > log |ao|. (2.3.17) 

0 27 
2. Symmetric form: The polynomial Р(жі,...,2,)- 5 бетт BY s p. 

|| 1 
where a = (a1,...,a у) can be written in the symmetric form 
N 

СОТ ЕЕ РА азе (2.3.18) 


і1,-4т--і1 


1 o" p : . : 
ml Өтү cO This means that the x 172 term is written as 


5 (2122 + тәті), the term 2112 becomes (212222 + Todito + 092201). 


with О ЖБ 


3. The Mahler measure (a valuation) of the polynomial P(x) = anz” +an 11"! 
+++ + ao = ам(@ — 21)(@ —22)...(x — Zn) is given by 


n 1 
M(P) = |an] L max(1, |24) = exp (/ log |Р (e77?) | 4) | 
121 0 
This valuation satis es the properties: 
(a) M(P) M(Q) = M(PQ) 
(b) M(P(z)) = М(Р(25)) fork > 1 
(c) M(x" P(a~")) = М(Р(г)) 


2.4 NUMBER THEORY 


2.4.1 DIVISIBILITY 


The notation “a|b” means that the number a evenly divides the number b. That is, 
the ratio 9. 1s ап integer. 
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2.4.2 CONGRUENCES 


1. If the integers a and b leave the same remainder when divided by the number 
n, then a and b are congruent modulo n. This is written a = b (mod n). 


2. If the congruence r = a (mod p) has a solution, then a is a quadratic residue 


of р. Otherwise, a is a quadratic non-residue of р. 


(a) Let p be an odd prime. Legendre’s symbol (2) has the value 4-1 if a is 
a quadratic residue of p, and the value —1 if a is a quadratic non-residue 
of p. This can be written (2) = a-1)/? (mod p). 


(b) The Jacobi symbol generalizes the Legendre symbol to non-prime mod- 
uli. If n = 5 р! then the Jacobi symbol can be written in terms of 
the Legendre symbol as follows 


(=) = П (2) | (2.4.1) 


i=1 


3. An exact covering sequence is a set of non-negative ordered pairs {(a;,b;) 1-1 
such that every non-negative integer n satis es n = a, (mod b,) for exactly 
one 7. An exact covering sequence satis es 


gh 1 
— = —. (2.4.2) 
— ybi = 
m 1-2 1-2 


For example, every positive integer n 18 either congruent to 1 mod 2, ог 0 


mod 4, or 2 mod 4. Hence, the three pairs {(1, 2), (0,4), (2,4)} of residues 
and moduli exactly cover the positive integers. Note that 


2 1 т? 1 


122 1571-0127 1520) 


4. Carmichael numbers are composite numbers n that satisfy a“! = 1 (mod n) 
for every a (with 1 < a « n) that is relatively prime to n. There are in nitely 
many Carmichael numbers. Every Carmichael number has at least three prime 
factors. If n = |], pi is a Carmichael number, then (p; — 1) divides (n — 1) 
for each i. 


There are 43 Carmichael numbers less than 109 and 105,212 less than 101°. 
The Carmichael numbers less than ten thousand are 561, 1105, 1729, 2465, 
2821, 6601, and 8911. 
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2.4. 
1 


2 


3. 


2.1 Properties of congruences 
. Ifa =b (mod n), then b = a (mod n). 


. Ifa =b (mod n), and = c (mod n), then a = c (mod n). 
If a Z a (mod n), and b = V (mod n), then a +b = a' + 6 (mod n). 
Шаа! (mod n), then a? = (а)? (mod n), а? = (а)? (mod n), etc. 


. If GCD(k,m) = d, then the congruence kx = n (mod m) is solvable if and 
only if d divides n. It then has d solutions. 


6. If pisa prime, then a? = a (mod p). 


© 00 N 


10. 


11. 


12. 


13. 


14. 


. If pis a prime, and p does not divide a, then a?7! = 1 (mod р). 
. If GCD(a, m) = 1 then a?) = 1 (mod m). (See Section 2.4.15 for ó(m).) 


. If p is an odd prime and a is not a multiple of p, then Wilson's theorem states 
(p — 1)! = — (8) а@—1)/? (mod p). 


If p and q are odd primes, then Gauss's law of quadratic reciprocity states that 


Ө (2 = (-1)®-DG-))/* | Therefore, if a and b are relatively prime odd 
4 р 


integers and b > 3, then (5) exe poo Na (2) | 
а 


The number —1 is a quadratic residue of primes of the form 4k + 1 and a 
non-residue of primes of the form 4k + 3. That is 


(=) 2(-1)Р-07 = +1 whenp=1 (mod 4) 
p —1 whenp=3 (mod 4) 


The number 2 is a guadratic residue of primes of the form 8k + 1 and a non- 
residue of primes of the form 8k + 3. That is 


(5) Ш (-1) 07-98 _ J+1 whenpz +1 (mod 8) 
i 1-1 whenpz £3 (mod 8) 


The number —3 is a quadratic residue of primes of the form 6k 4- 1 and a 
non-residue of primes of the form 6k + 5. 


The number 3 is a quadratic residue of primes of the form 12k + 1 and a 
non-residue of primes of the form 12k + 5. 
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2.4.3 CHINESE REMAINDER THEOREM 


Let mi,mo»,...,m, be pairwise relatively prime integers. Then the system of 
congruences 


a, (mod mi) 


аз (mod т») 
(2.4.4) 


x Za, (mod mr) 


has a unique solution modulo М = тіто ··· т. This unique solution can be 
written as 

x= а Муу + a3 Му + +++ + a, MrYr (2.4.5) 
where М, = M/mx, and yy is the inverse of M, (modulo mg). 
EXAMPLE For the system of congruences 

x=1 (mod 3) 

(mod 5) 
x=3 (mod?) 


в 
Ill 
N 


we have M = 3-5-7 = 105. Hence М, = 35, Мә = 21, and Мз = 15. The equation 
for yı is Муу = 35yı = 1 (mod 3) with solution yı = 2 (mod 3). Likewise, y» = 
1 (mod 5) and yz = 1 (mod 7). This results in = 1-35-2+2-21-1+3-15-1 = 52 
(mod 105). 


2.4.4 CONTINUED FRACTIONS 


The symbol | о, a1,..., an], with a, > 0, represents the simple continued fraction, 
1 
(00,41....,ам| Б Res (2.4.6) 
+ 
ал Я 1 
аә 1 
аз + 
a4 + 1 
тоор сг: 
ам 
The n™ convergent (with 0 < n < №) of [ao, a1, ... „a n] is de ned tobe[ao,a1,.. . „an]. 


If {py} and {qn } are de ne d by 


ро = а0, pı —ajd0 +1, рь = аърь-1 +Pn—2 (2<n<N) 
0 =1, а= а, dn = баба-і-- 4-2 (2 <п< №) 


then [ao,a1,...,a4] = Pn/dn. The continued fraction is convergent if and only if 
the in nite series 27/7 a; is divergent. 


© 2003 by CRC Press LLC 


If the positive rational number x can be represented by a simple continued frac- 
tion with an odd (even) number of terms, then it is also representable by one with 
an even (odd) number of terms. (Speci cally , if an = 1 then [ao,...,a4 1, 1] = 
[a0, ..., àn—1 + 1], and if ад > 2, then [ao,..., an] = [ao,..., a4 — 1, 1].) Aside 
from this indeterminacy, the simple continued fraction of x is unique. The error in 
approximating by a convergent is bounded by 


1 1 
< — < =. (2.4.7) 
ЯТТЫ 


Pn 
dn 


r — 


The algorithm for ndin g a continued fraction expansion of a number is to re- 
move the integer part of the number (this becomes a ,), take the reciprocal, and repeat. 
For example, for the number т: 


Bo = T ғ 3.14159 ao = [60] = З 
Bı = 1/(Во — ао) ~ 7.062 a = [51] =7 
Bo = 1/(81 — a1) s 15.997 az = [52] = 15 
Вз = 1/(B2 — az) ~ 1.0034 аз = [53] = 1 
Ba = 1/(6: — аз) ~ 292.6 ад = |84] = 292 


Approximations to т and e may be found from т = [3, 7, 15, 1, 292, 1, 1, 1, 2, 1, 3, 
1, 14, "E ..Jande = = (2, 1, 2, 1, 1, 4, 1, 1, 6,...,1,1,2п,. zh The convergents for 
т are 22 as 3.142, 333 x А 14150, 255 ~ 3.1415929, 103995 ~ 31415926530, . 


= 106 > Ш | m = 33102 
The sonvernents for e are 3 X 2.6, 7 & 2.75, = & 2. 714, 87 32 2 2.7187,. 

А periodic continued LUE m an in DE continued fraction in which a1 — 
ак for all! > L. The set of partial quotients аг, алф, ..., @L+k—1 is the period. 
A periodic continued fraction may be written as 

[aos 0155 cs Br 01:01:11) оар |е (2.4.8) 


For example, 


v2=[1,2] e| 
УЗ = [1,1,2] СУТ =[ 
vA = [2] V8 = [ 

=[2,4) V9=[ 


If x = [b,a] then z = 4(b+4/b? + 20). For example, [T] = 
[2] = [2,2] = 1 + v2, and [2,1] = 1 + V3. 


Functions can be represented as continued fractions. Using the notation 


[3 V14 = [3, 

[3 V15 [3 , 

L4 V12 = [3,2,6 VAST 
[3 V17 = [4,8 

[1,1] = (1+ V5)/2, 


a1 ар G2 аз Q4 
bg + —————— = bo + —————... 2.4.9 
0 аә by + 65+ 03+ bat ( ) 


pen 
bat... 


we have (allowable values of z may be restricted in the following) 
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— £ 2 2 Az Az 92 


(а) (1+) aera ae se 


2.4.5 DIOPHANTINE EQUATIONS 


A diophantine equation is one which requires the solutions to come from the set of 
integers. 


1. Apart from the trivial solutions (with x = y = 0 or = и), the general 
solution to the equation z? + y? — už + v? is given by 
шж = А[1— (a — 3b)(a“ + 3b5)] y =A [(a + 3b) (až + 30°) — 1] 
u = А [(а + 3b) — (а + 3b%)%] v =A (а? + 30°)? — (a — 3b)] 


(2.4.10) 
where (A, a, b) are any rational numbers except that A Æ 0. 
2. A parametric solution to z^ + y* = u“ + v! is given by 
x — a! + а? — 2а5Ь° + 3a7b° + ab“ 
у = afb — За? — 2а + а + b" 
(2.4.11) 


ца + ab? — 2ab+ — 3a? b + ab“ 
v = afb + За? — Зай? + ab + b" 


3. Fermať s last theorem states that there are no integer solutions to r"? +y” = 2", 
when n > 2. This was proved by Andrew Wiles in 1995. 


4. Bachet’s equation, y? = x? + k, has no solutions for k equal to any of the 
following: —144, —105, —78, —69, —42, —34, —33, —31, —24, —14, —5, 7, 
11, 23, 34, 45, 58, 70. 


2.4.5.1 Pythagorean triples 


If the positive integers A, В, and C satisfy the relationship A“ + B? = С?, then the 
triplet (A, B, C) is a Pythagorean triple. It is possible to construct a right triangle 
with sides of length A and В and a hypotenuse of С. 

There are in nitely many Pythagorean triples. The most general solution to 
A? + B? = С°, with GCD(A, В) = 1 and A even, is given by 


А-2:/ В=а2- у) C=r +p’, (2.4.12) 
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where x and y are relatively prime integers of opposite parity (1.е., one is even and 
the other is odd) with x > y > 0. The following table shows some Pythagorean 
triples with the associated (т, y) values. 


- 
BANWOAD AN 


2.4.5.2 Pelľs equation 


Pell’s equation is z? — dy? = 1. The solutions, integral values of (x, y), arise from 
continued fraction convergents of Vd (see page 96). If (x,y) is the least positive 
solution to Pell’s equation (with d square-free), then every positive solution (x k, ук) 
is given by 


zy + ykV d = (x + ума)“. (2.4.13) 


The following tables contain the least positive solutions to Pell’s equation with d 
square-free and d < 100. 


2,281,249 267,000 

2,049 3,699 430 
13 351 
3,482 53 
24,335 80 

48 163 18 

50 82 9 

66,249 285,769 30,996 

89 12 10,405 1,122 

151 28 3 

19,603 2,574 500,001 53,000 

530 69 1,574 165 

1,766,319,049 | 226,153,980 12,151 1,260 

63 2,143,295 221,064 

129 16 39 4 

65 62,809,633 | 6,377,352 

48,842 
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EXAMPLES 


1. The number 4/2 has the continued fraction expansion [1,2,2,2,2,...], with conver- 
3 717 41 99 : ы 
gents 5, =, 15 6» 7g»... In this case, every second convergent represents a solution: 


3292.9? =1, 
17? — 2.12? — 1, and 
99? —2. 10? — 1. 


2. The least positive solution for d = 11 is (x,y) = (10,3). Since (10 + 3/11)? = 
199 + 604/11, another solution is given by (xo, y») = (199, 60). 


2.4.5.3 Waring's problem 


If each positive integer can be expressed as a sum of n k“ powers, then there is a 
least value of n for which this is true: this is the number g(k). For all suf ciently 

large numbers, however, a smaller value of n may suf ce: this is the number G(K). 
Waring's problem is to determine g(n) and G (n). 


1. Lagrange's theorem states: “Every positive integer is the sum of four squares"; 
this is equivalent to the statement g(2) — 4. The following identity shows how 
a product can be written as the sum of four squares: 


(a1 + 25 + 23 + 204) (07 + уз +93 +04) = (24.14) 
(2101 + 2272 + 2303 + rays)” + (x1 y2 — toy1 + 23y4 — тар)! 
+ (£1Y3 — 2901 + Layo — тәу)! + (2104 = 2401 + T2Y3 — 2392)? 


2. Consider k = 3; all numbers can be written as the sum of not more than 9 
cubes, so that g(3) = 9. However, only the two numbers 


23 = 2 + 28 1? 4194194194174 12413, 
239 = 43 + 43 + 35 + 33 +3? +38 +18 +12 I, 


require the use of 9 cubes; so G(3) « 8. 


3. G(k) < 6klog k + (4 + 3log (3+ 2)) k +3. 
g(2) = 4 GQ) = 4 
g(3) = 9 4< G(3) <7 


g(4) = 19 G(4) = 16 

g(5) — 37 6 < G(5) < 18 
g(6) = 73 9 < G(6) < 27 
143 « g(7) < 306 8 < G(7) < 36 


4. Known values include 


279 < g(8) < 36,119 | 32 < G(8) < 42 
548 < g(9) 13 < G(9) < 82 
1,079 < g(10) 12 < G(10) < 102 
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2.4.66 GREATEST COMMON DIVISOR 


The greatest common divisor of the integers n and m is the largest integer that evenly 
divides both n and m; this is written as GCD(n, m) or (т, т). The Euclidean algo- 
rithm is frequently used for computing the GCD of two numbers; it utilizes the fact 
that m = |Z| n + p where0 € p « n. 

Given the integers m and n, two integers a and b can always be found so that 
am + bn = GCD(n, m). 

Two numbers, m and n, are said to be relatively prime if they have no divisors in 
common: i.e., if GCD(a, b) = 1. The probability that two integers chosen randomly 
are relatively prime is 7/6. 


EXAMPLE Consider 78 and 21. Since 78 = 3 - 21 + 15, the largest integer that evenly 
divides both 78 and 21 is also the largest integer that evenly divides both 21 and 15. 
Iterating results in: 


1823-21 +15 
21—1.15 +6 
15=2:6+3 
6-2-3-0 


Hence GCD(78, 21) = GCD(21,15) = GCD(15, 6) = GCD(6, 3) = 3. Note that 
78-(-4)--21-15-43. 


2.4.7 LEAST COMMON MULTIPLE 


The least common multiple of the integers a and b (denoted LCM (a, b)) is the small- 
est integer r that is divisible by both a and b. The simplest way to nd the LCM of a 


and b is via the formula LCM(a, b) — ab/GCD(a, b). For example, LCM(10,4) — 
10:4-тү = 104 = 20. 


GCD(10,4) — 


2.4.8 MAGIC SQUARES 


A magic square is a square array of integers with the property that the sum of the 
integers in each row or column is the same. If (c,n) = (d,n) = (e,n) = (f,n) 
(cf — en,n) = 1, then the array A = (а;;) will be magic (and use the n? numbers 
0, 1,...,n? — 1) if а; = k with 


i=ck+e B (mod n) and j=dk+ f B (mod n) 
n n 


For example, with c = 1, d = e = f 
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2.4.9 MÔBIUS FUNCTION 
The Mobius function is de ned by 


1. (1) 21 2. u(n) = 0 if n has a squared factor 


3. u(pip ... py) = (—1)* if all the primes (pi,. .. , рк} are distinct 


Its properties include: 


1. If GCD(m,n) = 1 then u(mn) = u(m) u(n) 


1 ifn=1 
: Soi, ifn>1 


dln 
= 1 
3. Generating function: ЫН pni = - 
2 0) 


The Möbius inversion formula states that, if g(n) = 5 f(d), then 


dln 
f(n) = 2 (5) g(d) = Daido (5) | (2.4.15) 
For example, the Mobius inversion of n = 5 o(d) is (n) =n 5 к 


dln dln 
The table below can be derived from the table in Section 2.4.13. The value of 
p(10n + k) is in row n- and column _k. 


Mobius function values 
(For example, (2) = —1, (4) = 0, and (6) = 1.) 


| 
= = 


TE © © HO E 
нн HO H H OH O 


0 
1 
0 
1 
0 
1 
0 
1 
0 
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2.4.10 PRIME NUMBERS 


1. A prime number 1s a positive integer greater than 1 with no positive, inte- 
gral divisors other than 1 and itself. There are in nitely many prime num- 


bers, 2,3,5,7,.... The sum of the reciprocals of the prime numbers diverges: 
j--—. ИТЕ 1 = 
ХА ats tr eo 


2. Twin primes are prime numbers that differ by two: (3,5), (5,7), (11,13), 
(17,19),.... It is not known whether there are in nitely many twin primes. 
The sum of the reciprocals of the twin primes converges; the value 


pe р se а Мыл + 
E 5 5 7 11 13 ав р р-2 2x 


known as Brun's constant is approximately В ғ 1.90216054. 


3. For every integer n > 2, the numbers (n! + 2,n! + 3,...,n! + n} are a 
sequence of n — 1 consecutive composite (1.e., not prime) numbers. 


4. Dirichlet’s theorem on primes in arithmetic progressions: Let a and b be rel- 
atively prime positive integers. Then the arithmetic progression an + b (for 
n — 1,2,...) contains in nitely many primes. 


5. Goldbach conjecture: every even number is the sum of two prime numbers. 


6. The function c (x) represents the number of primes less than x. The prime 
number theorem states that r(x) ~ z/logz as © > oo. The exact number of 
primes less than a given number is: 


x 100 1000 10,000 10° 10% 107 108 
mx) | 25 168 1,229 9,592 78,498 664,579 5,761,455 


x 1079 1015 10?! 


T(x) | 455,052,511  29,844,570,422,669 21,127,269,486,018,731,928 


2.4.10.1 Prime formulae 


The polynomial x? — x + 41 yields prime numbers when evaluated at x = 0, 1, 2, 
snag 39. 


The set of prime numbers is identical with the set of positive values taken on by 
the polynomial of degree 25 in the 26 variables {a,b,...,z}: 
(k +2)11—[wz+h+j—aÉ — [(gk--2g - k--1)(h- 3) -h—2] —[2n+p+4+2—e] 
— [16(k-- 1)? (k--2)(n--1)* -1— P Ť – [e (e2) (a4-1)! 41-9] (а? —1)y^ 41-22 
—[16r?y^ (a? —1)--1—w? P —[((a--u? (и? —a))“ —1) (n--4dy)? +1—(1+cu)] [һо]? 
[((a? —1)? -1—m?J —[a1+k+1-1-14] — [p--L(a—n —1) -b(2an--2a — n? -2n—2) m] 


—[g4-y(a—p—1)4-s(2ap4-2a p —2p 2) 2] [z4-pl (a p) H(?2ap—p“ —1) —pm] Y. 
(2.4.16) 
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Although this polynomial appears to factor, the factors are improper, Р = Р.1. Note 
that this formula will also take on negative values, such as —76. There also exists 
a prime representing polynomial with 12 variables of degree 13697, and one of 10 
variables and degree about 104°. 


2.4.10.2 Lucas-Lehmer primality test 


De ne the sequence rm41 = r2, — 2 with rı = 3. If pis a prime of the form 4n + 3 
and M, = 2? — 1, then M, will be prime (called a Mersenne prime) if, and only if, 
M, divides rp —1. 

This simple test is the reason that the largest known prime numbers are Mersenne 
primes. For example, consider р = 7 and M; = 127. The {rn} sequence is (3, 7, 
47, 2207 = 48, 2302 = 16, 254 = ОҚ hence M; is prime. 


2.4.10.3 Primality test certi cates 


A primality certi cate is an easily veri ab le statement (easier than it was to deter- 
mine that it was prime in the rst place) that proves that a specic number is prime. 
There are several types of certi cates that can be given. The Atkin—Morain certi cate 
uses elliptic curves. 

To prove that the number p is prime, Pratt’s certi cate consists of a number a 
and the factorization of the number p — 1. The number p will be prime if there exists 
a primitive root a in the eld GF[p]. This primitive root must satisfy the conditions 
a?-! = 1 (mod p) and a®-))/4 4 1 (mod p) for any prime g that divides p — 1. 


EXAMPLE Тһе number p = 31 has p — 1 = 30 = 2.3. 5, and a primitive root is given 
by a — 3. Hence, to verify that p — 31 is prime, we compute 


361-1У/2 — 315 = 14348907 = —1 41 (mod 31), 
3(3171)/3 2 31? = 59049 = 25 41 (mod 31), 
3@!—1)/5 — 36 2729216%1 (mod 31), 

Вее Бажи! =(-1}?=1 (mod 31). 


2.4.10.4 Probabilistic primality test 


Let n be a number whose primality is to be determined. Probabilistic primality tests 
can return one of two results: either a proof that the number n is composite or a 
statement of the form, “The probability that the number n is not prime is less than 
€", where є can be speci ed by the user. Typically, we take є = 27700 < 10760. 

¿From Fermať s theorem, if b Z 0, then 57-1 = 1 (mod n) whenever n is 
prime. If this holds, then n is a probable prime to the base b. Given a value of n, if 
a value of b can be found such that this does not hold, then n cannot be prime. It can 
happen, however, that a probable prime is not prime. 

Let P(x) be the probability that n is composite under the hypotheses: 


1. nis an odd integer chosen randomly from the range [2, x]: 
2. bis an integer chosen randomly from the range [2, n — 2]: 
3. nis a probable prime to the base b. 
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Then Р(х) < (logx)“! for æ > 1010000. 

A different test can be obtained from the following theorem. Given the number 
n, nd sandt with n — 1 = 25, with t odd. Then choose a random integer b from 
the range [2, n — 2]. If either 


b —1 (modn) or = -1 (modnm), forsomei < s, 


then n is a strong probable prime to the base b. Every odd prime must pass this test. 
If n > 1 is an odd composite, then the probability that it is a strong probable prime 
to the base b, when b is chosen randomly, is less than 1 / 4. 

A stronger test can be obtained by choosing k independent values for b in the 
range [2, n — 2] and checking the above relation for each value of b. Let Р, (x) be 
the probability that n is found to be a strong probable prime to each base b. Then 
P,(z) < 4- 6-9 Р(а) (1 = P(z)). 


2.4.11 PRIME NUMBERS OF SPECIAL FORMS 


1. The largest known prime numbers, in descending order, are 


Prime number Number of digits 


213460077..] 1,053,946 
26972593 _ 1 2,098,960 
23021377 _1 909,526 
22976221 — 1 895,932 


21398269 _ 1 420,921 
126606265536 + 1 399,931 
5. 21320487 } 1 397,507 
85767865536 + 1 388,847 
84383265536 + 1 388,384 
5. 21282755 } 1 386,149 


2. The largest known twin primes are: 318032361 - 2107001 + 1 (with 32,220 
digits), 1807318575-298305+1 (with 29,603 digits), and 665551035.280025--1 
(with 24,099 digits). 

3. There exist constants 9 s 1.30637788 and w ғә 1.9287800 such that (ӨР 

au 
27 : 
> 1. 
апа |2 are prime for every n > 1 


n 


4. Primes with special properties 
(a) A Sophie Germain prime p has the property that 2p + 1 is also prime. 
Sophie Germain primes include: 2, 3, 5, 11, 23, 29, 41, 53, 83, 89, 


113, 131, ..., 3714089895285 - 290000 — 1, 984798015 - 266444 — 1, 
109433307 . 206452 — 1,.... 
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(b) An odd prime р is called a Wieferich prime if 22-1 = 1 (mod p°). 
Wieferich primes include 1093 and 3511. 

(с) A Wilson prime satis es (p — 1)! = —1 (mod p°). Wilson primes in- 
clude 5, 13, and 563. 


5. For each n shown below, the numbers {a + md | m = 0,1,...,n — 1} are an 
arithmetic sequence of n prime numbers: 


n a a + (n — 1)d d 
3 3 7 2 
4 61 79 6 
5 11 131 30 
10 199 2089 210 


22 11410337850553 108201410428753 4609098694200 
6. Dene p+ to be the product of the prime numbers less than or egual to р. 


Values of n or p for which the form is prime 


0,1,2,3,4... (Fermat primes) 
n 


2^ —1 |2,3,5, 7, 13, 17, 19, 31, 61, 89, 107, 127, 521, 607, 1279, 
2203, 2281, 3217, 4253, 4423, 9689, 9941, 11213, 19937, 
21701, 23209, 44497, 86243, 110503, 132049, 216091, 


156839, 859433, 1257787, 1398269, 2976221, 3021377, 
6972593, ..., 13466917 ... (Mersenne primes) 
3, 4, 6, 7, 12, 14, 30, 32, 33, 38, 94, 166, 324, 379, 469, 
546, 974, 1963, 3507, 3610, 6917, ... 

(factorial primes) 
1,2, 3, 11, 27, 37, 41, 73, 77, 116, 154, 320, 340, 399, 427, 
872, 1477, 6380, ... (factorial primes) 
3,5, 11, 13, 41, 89, 317, 337, 991, 1873, 2053, 2377, 4093, 
4297, 4583, 6569, 13033, 15877, ... 


(primorial primes) 
2, 3, 5, 7, 11, 31, 379, 1019, 1021, 2657, 3229, 4547, 4787, 
11549, 13649, 18523, 23801, 24029, 42209, ..., 145823, 
366439, 392113, ... (primorial primes) 
1, 141, 4713, 5795, 6611, 18496, 32292, 32469, 59656, 
90825, 262419, 361275, ..., 481890, ... 


(Cullen primes) 
2, 3, 6, 30, 75, 81, 115, 123, 249, 362, 384, 462, 512, 751, 
822, 5312, 7755, 9531, 12379, 15822, 18885, ... 143018, 
151023, 667071, ... (Woodall primes) 
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| a” 
7. Prime numbers of the form 


—1 
1 (called repunits). 


Form | Values of n for which the form 1s prime 
These are Mersenne primes: see the previous table. 


3, 7, 13, 71, 103, 541, 1091, 1367, 1627, 4177, 9011, 9551, . 


3, 7, 11, 13, 47, 127, 149, 181, 619, 929, 3407, 10949, ... 


2, 3, 7, 29, 71, 127, 271, 509, 1049, 6389, 6883, 10613, . 


5, 13, 131, 149, 1699, . 
2, 19, 23, 317, 1031, 49081, 86453, . 


17, 19, 73, 139, 907, 1907, 2029, 4801, 5153, 10867, . 


2, 3, 5, 19, 97, 109, 317, 353, 701, 9739, . 


8. Prime numbers of the forms 2" + a, 10" + b, and 16" + c. 


In the following table, for a given value of n, the quantities a+, b+, and c+ 
are the least values such that 2" + a+, 10" + b+, and 16” + c+ are probably 
primes. (A probabilistic primality test was used.) For example, for n — 3, 
the numbers 22 — 1 = 7, 22 + 3 = 11, 10? — 3 = 997, 10? + 9 = 1009, 
16? — 3 = 4093, and 16? + 3 = 4099 are all prime. 
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2.4.12 PRIME NUMBERS LESS THAN 100,000 


The prime number р1ол-„к is found by looking at row n „and the column k. 


© 2003 by СКС Press LLC 


© 2003 Ьу СКС Press LLC 


5351 


5437 
5507 
5591 
5683 
5779 


5849 
5923 
6043 
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10267 


10337 
10457 
10559 
10651 
10733 


10853 
10939 
11057 
11131 
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15107 
15199 
5287 
5361 
5451 


5559 
5647 
15737 
5809 
5913 


6033 
6103 
6223 
6339 
16433 


11717 


11813 
1903 
1971 
2073 


2263 
2373 
2451 
2527 
2611 


2697 
2799 
2907 
2979 
13063 


13163 
3259 
13367 
13463 
13577 


13681 
13751 


15121 
15217 
5289 
5373 
5461 


5569 
15649 
15739 
5817 
5919 


6057 
6111 
6229 
16349 
16447 


5053 


5137 
5233 
5307 


11831 
1927 
2007 
2107 
2203 


12281 
2391 
2479 
12547 
2637 


2721 
12823 
12919 
13003 
13103 


13183 
13297 
13399 
3487 
3613 


3693 
3763 
3877 
3963 
4071 


177 
321 
411 
503 
591 


683 
759 
843 
939 
15061 


15139 
5241 
15313 
15391 
5493 


5601 
15671 
5767 
15877 
15959 


16067 
6141 
16253 
6369 


20477 
20563 
20707 
20773 
20899 


21001 
21089 
21179 
21283 
21391 


21493 
21569 
21649 
21757 
21851 


21961 


N NNNNN NNNN 
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18341 


18439 
18523 
18671 
18773 
18913 


19031 
19141 
19237 
19373 
19429 


19489 
19583 
19717 
19813 
19919 


19997 
20101 
20173 
20287 
20369 


20479 
20593 
20717 
20789 
20903 


21011 
21101 
21187 
21313 
21397 


21499 
21577 
21661 
21767 
21859 


21977 


N Мә о о о о NNNN 


6547 
16649 
6741 
6871 
16943 


17033 
7137 
7239 
7351 
17431 


17509 
17609 
7729 
17837 
7923 


18013 
18119 
18199 
18287 
8371 


6553 
16651 
16747 
6879 
16963 


17041 
7159 
17257 
7359 
17443 


17519 
7623 
17737 
17839 
7929 


8041 
8121 
8211 
8289 
18379 


8461 
8583 
8713 
8803 
8959 


19073 
19183 
9273 
9391 
19457 


9541 
19661 
9753 
19853 
19961 


20029 
20123 
20219 
20333 
20407 


20521 
20639 
20747 
20857 
20947 


21023 
21143 
21221 
21341 
21433 


21523 
21601 
21713 
21803 
21893 


22013 


20047 
20129 
2023 
2034 
2041 


20533 
2064 
20749 
20873 
20959 


2103 
21149 
21227 
21347 
21467 


21529 
21611 
21727 
21817 
21911 


22027 


6567 
6661 
6763 
6889 
6981 


7053 
7183 
7293 
7383 
7467 


7551 
7657 
7749 
7863 
7957 


8047 
8131 
8223 
8307 
8401 


8493 
8593 
8731 
8859 
8979 


9081 
9211 
9301 
9417 
9469 


9553 
9687 
9763 
9867 
9973 


20051 
20143 
20233 
20347 
20431 


20543 
20663 
20753 
20879 
20963 


21059 
21157. 
21247 
21377 
21481 


21557 
21613 
21737 
21821 
21929 


22031 


6573 
16673 
16787 
6901 
16987 


17077 
7189 
17299 
17387 
7471 


17569 
7659 
7761 
7881 
7959 


8049 
18133 
18229 
18311 
18413 


18503 
18617 
18743 
18869 
19001 


19087 
19213 
19309 
19421 
19471 


19559 
19697 
19777 
19889 
19979 


20063 
20147 
20249 
20353 
20441 


20549 
20681 
20759 
20887 
20981 


21061 
21163 
21269 
21379 
21487 


21559 
21617 
21739 
21839 
21937 


22037 


23333 
23473 


25307 
25409 


25523 
25609 
25703 
25801 
25919 


26003 
26113 
26209 
26309 
26407 


26501 
26641 
26713 
26813 
26893 


26993 
27091 
27239 
27337 
27457 


27581 
27697 
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n 
ON N 


won 


22091 
22159 
22279 
22391 


22501 
22619 
22699 
22783 
22901 


23011 
23063 
23173 
23291 
23371 


23537 
23603 
23687 
23789 
23879 


25037 
25153 
25247 
25349 
25453 


25579 
25657 
25759 
25867 
25951 


26053 
26171 
26261 
26357 
26449 


26573 
26687 
26737 
26861 
26951 


27059 
27143 
27277 
27409 
27527 


27647 
27743 


22093 
22171 
22283 
22397 


22511 
22621 
22709 
22787 
22907 


23017 
23071 
23189 
23293 
23399 


23539 
23609 
23689 
2380 
23887 


2398 
2407 
24133 
24239 
24379 


2448 
2461 
24733 
24847 
24953 


25057 
25163 
25253 
25357 
25457 


25583 
25667 
25763 
25873 
25969 


26083 
26177 
26263 
26371 
26459 


26591 
26693 
26759 
26863 
26953 


27061 
27179 
27281 
27427 
27529 


27653 
27749 


22109 
22189 
22291 
22409 


22531 
22637 
22717 
22807 
22921 


23021 
23081 
23197 
23297 
23417 


23549 
23623 
23719 
23813 
23893 


23993 
24077 
24137 
24247 
24391 


24499 
24623 
24749 
24851 
24967 


25073 
25169 
25261 
25367 
25463 


25589 
25673 
25771 
25889 
25981 


26099 
26183 
26267 
26387 
26479 


26597 
26699 
26777 
26879 
26959 


27067 
27191 
27283 
27431 
27539 


27673 
27751 


22111 
22193 
22303 
22433 


22541 
22639 
22721 
22811 
22937 


23027 
23087 
23201 
23311 
23431 


23557 
23627 
23741 
23819 
23899 


25087 
25171 
25301 
25373 
25469 


25601 
25679 
25793 
25903 
25997 


26107 
26189 
26293 
26393 
26489 


26627 
26701 
26783 
26881 
26981 


27073 
27197 
27299 
27437 
27541 


27689 
27763 
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27199 
27901 
27997 


28097 
28211 
28319 
28439 
28547 


28619 
28687 
28789 
28879 
29017 


29129 
29207 
29311 
29401 


27803 
27917 
28001 


28099 
28219 
28349 
28447 
28549 


28621 
28697 
28793 
28901 
29021 


29131 


29531 


29633 
29759 
29873 
30011 
30109 


30197 
30307 
30427 
30529 
30649 


30757 
30851 
30941 
31063 
31153 


31237 
31321 
31469 
31547 
31663 


31769 
31891 
32029 
32117 
32213 


32321 
32381 
32491 
32573 
32687 


32789 
32909 
32987 
33073 
33181 


33311 
33391 
33493 


27809 
27919 
28019 


28109 
28229 
28351 
28463 
28559 


28627 
28703 
28807 
28909 
29023 


29137 
29221 
29333 
29423 
29537 


29641 
29761 
29879 
30013 
30113 


30203 
30313 
30431 
30539 
30661 


30763 
30853 
30949 
31069 
31159 


31247 
31327 
31477 
31567 
31667 


31771 
31907 
32051 
32119 
32233 


32323 
32401 
32497 
32579 
32693 


32797 
32911 
32993 
33083 
33191 


33317 
33403 
33503 


27817 
27941 
28027 


28111 
28277 
28387 
28477 
28571 


28631 
28711 
28813 
28921 
29027 


29147 
29231 
29339 
29429 
29567 


29663 
29789 
29881 
30029 
30119 


30211 
30319 
30449 
30553 
30671 


30773 
30859 
30971 
31079 
31177 


31249 
31333 
31481 
31573 
31687 


31793 
31957 
32057 
32141 
32237 


32327 
32411 
32503 
32587 
32707 


32801 
32917 
32999 
33091 
33199 


33329 
33409 
33521 


27823 
27943 
28031 


28123 
28279 
28393 
28493 
28573 


28643 
28723 
28817 
28927 
29033 


29153 
29243 
29347 
29437 
29569 


29669 
29803 
29917 
30047 
30133 


30223 
30323 
30467 
30557 
30677 


30781 
30869 
30977 
31081 
31181 


31253 
31337 
31489 
31583 
31699 


31799 
31963 
32059 
32143 
32251 


32341 
32413 
32507 
32603 
32713 


32803 
32933 
33013 
33107 
33203 


33331 
33413 
33529 
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38393 


38561 
38653 
38729 
38839 
38933 


39047 
39157 
39233 
39343 


33587 
33641 


33767 
33857 


35353 
35449 
35543 
35729 
35831 


35923 
36011 
36109 
36241 
36341 


36469 
36559 
36653 
36749 
36833 


36923 
37019 
37139 
37253 
37361 


37483 
37549 
37633 
37781 
37879 


37993 
38149 
38237 
38327 
38453 


38603 
38693 
38767 
38873 
38977 


39103 
39191 
39293 
39373 


33589 
33647 


33769 
33863 
33967 
34129 
34231 


34313 
34421 
34511 
34607 
34703 


34819 
34919 
35059 
3514 
35267 


35363 
3546 
35569 
3573 
35837 


35933 
36013 
3613 
3625 
36343 


36473 
36563 
3667 
3676 
36847 


36929 
3702. 
37159 
37273 
37363 


37489 
37561 
37643 
37783 
37889 


37997 
38153 
38239 
38329 
38459 


38609 
38699 
38783 
38891 
38993 


39107 
39199 
39301 
39383 


33599 
33679 


33773 
33871 
33997 
34141 
34253 


34319 
34429 
34513 
34613 
34721 


34841 
34939 
35069 
35149 
35279 


35381 
35491 
35573 
35747 
35839 


35951 
36017 
36137 
36263 
36353 


36479 
36571 
36677 
36767 
36857 


36931 
37039 
37171 
37277 
37369 


37493 
37567 
37649 
37799 
37897 


38011 
38167 
38261 
38333 
38461 


38611 
38707 
38791 
38903 
39019 


39113 
39209 
39313 
39397 


33601 
33703 


33791 


35393 
35507 
35591 
35753 
35851 


35963 
36037 
36151 
36269 
36373 


36493 
36583 
36683 
36779 
36871 


36943 
37049 
37181 
37307 
37379 


37501 
37571 
37657 
37811 
37907 


38039 
38177 
38273 
38351 
38501 


38629 
38711 
38803 
38917 
39023 


39119 
39217 
39317 
39409 
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39619 
39727 
39829 
39901 
40031 


40129 
40237 
40387 
40499 
40597 


40751 
4084 
4093 
4104 
4114 


4122 
4134 
4145 
4154 
4164 


41759 
41863 
41953 
42023 
42157 


42227 
42337 
42433 
42491 
42641 


42709 
42197 
42923 
43013 
43133 


43271 
43403 
43541 
43627 
43753 


43867 


Зоозл оло 


39509 
39623 


39659 
39761 
39847 
39953 
40063 


40163 
40277 
40429 
40529 
40637 


40771 
40853 
40961 
41077 
41179 


41243 
41381 
41491 
41597 
41659 


41777 
41893 
41969 
42071 
42181 


42281 
42373 
42451 
42533 
42667 


42737 
42839 
42943 
43049 
43177 


43313 
43441 
43577 
43651 
43781 


43913 
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5144 


45491 
45589 
45697 
45823 
45949 


46061 
46171 
46273 
46399 
46499 


46601 
46691 
46811 
46901 
47059 


47149 
47293 
47387 
47501 
47591 


47699 
47791 
47903 
47981 
48121 


48247 
48371 
48479 
48563 
48673 


48781 
48869 
49003 
49103 
49193 


49297 
49409 
49499 
49613 
49727 


49811 
49927 
50033 
50119 
50227 


50333 
50441 
50551 
50683 
50833 


50929 
51047 
51169 
51263 
51383 


51461 


50231 


50341 
50459 
50581 
50707 
50839 


50951 
51059 
51193 
51283 
51407 


51473 


50261 


50359 
50461 
50587 
50723 
50849 


50957 
51061 
51197 
51287 
51413 


51479 


45971 


46093 
46187 
46307 
46441 
46523 


46639 
46727 
46829 
46957 
47111 


47207 
47309 
47417 
47521 
47623 


47713 
47809 
47933 
48029 
48163 


48281 
48407 
48491 
48593 
48731 


48809 
48889 
49031 
49121 
49207 


49333 
49429 
49531 
49639 
49747 


49843 
49943 
50053 
50131 
50263 


50363 
50497 
50591 
50741 
50857 


50969 
51071 
51199 
51307 
51419 


51481 


52363 


52511 
52583 
52711 
52817 
52937 


53047 
53129 
53233 
53353 
53453 


55109 


55219 
55339 
55469 
55609 
55681 


55799 
55871 
55967 
56093 
56197 


56311 
56437 
56509 
56611 
56713 


56813 
56911 
56993 
57107 
57193 


57287 
57397 
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55807 
55889 
55987 
56099 
56207 


56333 
56443 
56519 
56629 
56731 


56821 
56921 
56999 
57119 
57203 


57301 
57413 


51551 
51647 
51767 
51859 


51971 
52069 
52183 
52291 
52433 


52553 
52667 
52757 
52883 
52973 


53089 
53173 
53281 
53407 
53549 


53629 
53731 
53857 
53939 


55291 
55399 
55541 
55639 
55721 


55823 
55921 
56039 
56131 
56249 


56383 
56477 
56543 
56671 
56773 


56873 
56951 
57059 
57149 
57251 


57349 
57487 


51563 
51659 
51769 
51869 


51973 
5208 
52189 
5230 
52453 


5256 
52673 
52769 
52889 
5298 


53093 
53189 
53299 
5341 
5355 


53633 


54193 
5433 
54419 
54517 
5460 


54713 
54833 
54959 
5506 
5520 


55313 
5541 
55547 
5566 
55733 


55829 
55927 
5604 
56149 
56263 


56393 
56479 
56569 
56681 
56779 


56891 
56957 
57073 
57163 
57259 


57367 
57493 


51577 
51673 
51787 
51871 


51977 
52103 
52201 
52313 
52457 


52567 
52691 
52783 
52901 
52999 


53101 
53197 
53309 
53419 


51581 
51679 
51797 
51893 


51991 
52121 
52223 
52321 
52489 


52571 
52697 
52807 
52903 
53003 


53113 
53201 
53323 
53437 
53591 


53653 


55333 
55441 
55589 
55667 
55787 


55843 
55933 
56081 
56171 
56269 


56417 
56501 
56597 
56701 
56807 


56897 
56983 
57089 
57179 
57271 


57383 
57527 
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57601 
57713 
57793 


57901 
58031 
58129 
58211 
58337 


58427 
58549 
58679 
58771 
58921 


59021 
59107 
59207 
59333 
59407 


59497 
59621 
59707 
59809 
59981 


60091 
60169 
60317 
60443 
60601 


60661 
60763 
60899 
61001 
61129 


61283 
61381 
61493 
61603 
61673 


61813 
61949 
62039 
62137 
62233 


62383 
62501 
62617 
62731 
62861 


62971 
63079 
63211 
63337 
63419 


63521 
63607 
63691 


57637 
57719 
57803 


57917 
58043 
58147 
58217 
58363 


58439 
58567 
58687 
58787 
58937 


59023 
59113 
59209 
59341 
59417 


59509 
59627 
59723 
59833 
59999 


60101 
60209 
60331 
60449 
60607 


60679 
60773 
6090 
61007 
6114 


6129 
61403 
61507 
61609 
6168 


61819 
6196 
62047 
6214 
62273 


6240 
62507 
62627 
62743 
62869 


62981 
63097 
63241 
63347 
63421 


63527 
63611 
63697 


5764 
5772 
5780 


5792. 
5804 
5815 
5822 
5836 


5844 
5857 
5869 
5878 
5894 


59029 
59119 
59219 
59351 
59419 


59513 
59629 
59729 
59863 
60013 


60103 
60217 
60337 
60457 
60611 


60689 
60779 
60913 
61027 
61151 


61297 
61409 
61511 
61613 
61687 


61837 
61967 
62053 
62143 
62297 


62417 
62533 
62633 
62753 
62873 


62983 
63103 
63247 
63353 
63439 


63533 
63617 
63703 


58369 


58451 
58579 
58699 
58831 
58963 


59051 
59123 
59221 
59357 
59441 


59539 
59651 
59743 
59879 
60017 


60107 
60223 
60343 
60493 
60617 


60703 
60793 
60917 
61031 
61153 


61331 
61417 
61519 
61627 
61703 


61843 
61979 
62057 
62171 
62299 


62423 
62539 
62639 
62761 
62897 


62987 
63113 
63277 
63361 
63443 


63541 
63629 
63709 
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63781 
63863 


64019 
64153 
64279 
64403 
64567 


64661 
64783 
64901 
65027 
65119 


65203 
65327 
65437 
65551 
65633 


65717 
65837 
65951 
66067 
66173 


66347 
66457 
66553 
66683 
66791 


66889 
67003 
67121 
67211 
67307 


67427 
67511 
67601 
67741 
67819 


67933 
68041 
68161 
68281 
68449 


68539 
68683 
68771 
68897 
69011 


69143 
69239 
69379 
69467 
69623 


69763 
69859 
70001 
70111 


63793 
63901 


64033 
64157 
64283 
64433 
64577 


64663 
64793 
64919 
65029 
65123 


65213 
65353 
65447 
65557 
65647 


65719 
65839 
65957 
66071 
66179 


66359 
66463 
66569 
66697 
66797 


66919 
67021 
67129 
67213 
67339 


67429 
67523 
67607 
67751 
67829 


67939 
68053 
68171 
68311 
68473 


68543 
68687 
68777 
68899 
69019 


69149 
69247 
69383 
69473 
69653 


69767 
69877 
70003 
70117 


63799 
63907 


64037 
64171 
64301 
64439 
64579 


64667 
64811 
64921 
65033 
65129 


65239 
65357 
65449 
65563 
65651 


65729 
65843 
65963 
66083 
66191 


66361 
66467 
66571 
66701 
66809 


66923 
67033 
67139 
67217 
67343 


67433 
67531 
67619 
67757 
67843 


67943 
68059 
68207 
68329 
68477 


68567 
68699 
68791 
68903 
69029 


69151 
69257 
69389 
69481 
69661 


69779 
69899 
70009 
70121 


63803 
63913 


64063 
64187 
64303 
64451 
64591 


64679 
64817 
64927 
65053 
65141 


65257 
65371 
65479 
65579 
65657 


65731 
65851 
65981 
66089 
66221 


66373 
66491 
66587 
66713 
66821 


66931 
67043 
67141 
67219 
67349 


67447 
67537 
67631 
67759 
67853 


67957 
68071 
68209 
68351 
68483 


68581 
68711 
68813 
68909 
69031 


69163 
69259 
69401 
69491 
69677 


69809 
69911 
70019 
70123 
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70183 


70289 
70393 
70501 
70619 
70729 


70867 
70951 
71039 
71161 
71263 


71353 
71437 
71549 
71693 
71807 


71887 
71987 
72089 
72211 
72287 


72431 
72551 
72671 
72763 
72893 


72973 
73063 
73243 
73363 
73477 


73589 
73681 


75167 


75253 
75367 
75503 
75577 
75683 


75781 
75931 
76003 
76147 
76259 


70199 


70297 
70423 
70507 
70621 
70753 


70877 
70957 
71059 
71167 
71287 


71359 
71443 
71551 
71699 
71809 


71899 
71993 
72091 
72221 
72307 


72461 
72559 
72673 
72767 
72901 


72977 
73079 
73259 
73369 
73483 


73597 
73693 
73823 
73943 
74071 


74167 
74279 
74377 
74489 
74587 


74717 
74821 
74897 
75029 
75169 


75269 
75377 
75511 
75583 
75689 


75787 
75937 
76031 
76157 
76261 


70201 


70309 
70429 
70529 
70627 
70769 


70879 
70969 
71069 
71171 
71293 


71363 
71453 
71563 
71707 
71821 


71909 
71999 
72101 
72223 
72313 


72467 
72577 
72679 
72797 
72907 


72997 
73091 
73277 
73379 
73517 


73607 
73699 
73847 
73951 
74077 


74177 
74287 
74381 
74507 
74597 


74719 
74827 
74903 
75037 
75181 


75277 
75389 
75521 
75611 
75703 


75793 
75941 
76039 
76159 
76283 


70207 


70313 
70439 
70537 
70639 
70783 


70891 
70979 
71081 
71191 
71317 


71387 
71471 
71569 
71711 
71837 


71917 
72019 
72103 
72227 
72337 


72469 
72613 
72689 
72817 
72911 


73009 
73121 
73291 
73387 
73523 


73609 
73709 


75193 


75289 
75391 
75527 
75617 
75707 


75797 
75967 
76079 
76163 
76289 
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76847 


76963 
77093 
77237 
77317 
77419 


77521 
77591 
77699 
77783 
77929 


78041 
78167 
78277 
78427 
78539 


78643 
78781 
78877 
78989 
79147 


79241 
79349 
79433 
79589 
79687 


79813 
79889 
79997 
80147 
80231 


80329 
80471 
80603 
80681 
80779 


80897 
81001 
81071 
81181 
81299 


81409 
81551 
81649 
81749 
81883 


81971 
82051 
82189 
82267 
82393 


82507 


76403 
7651 
7663 
76757 
7687 


7699 
7710 
77239 
77323 
7743 


77527 
7761 
7771 
77797 
77933 


78049 
78173 
78283 
78437 
7854 


78649 


7915 


79259 
79357 
7945 
7960 
7969 


79817 
7990 
79999 
80149 
80233 


8034 
80473 
8061 
80683 
80783 


80909 
81013 
81077 
81197 
81307 


81421 
81553 
81667 
81761 
81899 


81973 
82067 
82193 
82279 
82421 


82529 


16423 
16537 
76651 
76777 
76883 


77017 
77141 
77249 
77347 
77471 


77549 
77621 
77719 
77813 
77969 


78079 
78191 
78307 
78467 
78569 


78691 
78797 
78893 
79043 
79159 


79279 
79379 
79493 
79613 
79697 


79829 
79907 
80039 
80167 
80251 


80363 
80491 
80627 
80701 
80803 


80917 
81019 
81097 
81203 
81343 


81457 
81563 
81677 
81773 
81919 


82007 
82129 
82217 
82307 
82463 


82549 
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82609 
82729 
82837 
82997 


83093 
83231 
83341 
83437 
83563 


83663 


85439 
85549 
85643 
85781 


85889 


86029 
86161 
86257 
86351 
86441 


86539 
86693 
86837 
86951 
87071 


87181 
87293 
87421 
87523 
87613 


87691 
87797 
87917 
88007 
88211 


88337 
88493 
88651 
88771 
88843 


88951 
89057 


82613 
82757 
82847 
83003 


83101 
83233 
83357 
83443 
83579 


83689 
83833 
83939 
84067 
8419 


84307 
84407 
84499 
8463 
8473 


84859 
8499 
85093 
85213 
8533 


85447 
8557 
8566 
85793 
85903 


86069 
8617 
86263 
86353 
86453 


8656 
8671 
86843 
86959 
87083 


87187 
87299 
87427 
87539 
87623 


87697 
87803 
87931 
88019 
88223 


88339 
88499 
88657 
88789 
88853 


88969 
89069 


82619 
82759 
82883 
83009 


83117 
83243 
83383 
83449 
83591 


83701 
83843 
83969 
84089 
84199 


84313 
84421 
84503 
84649 
84737 


84869 
85009 
85103 
85223 
85333 


85451 
85577 
85667 
85817 
85909 


86077 
86179 
86269 
86357 
86461 


86573 
86719 
86851 
86969 
87103 


87211 
87313 
87433 
87541 
87629 


87701 
87811 
87943 
88037 
88237 


88379 
88513 
88661 
88793 
88861 


88993 
89071 


83023 


83137 
83257 
83389 
83459 
83597 


83717 
83857 
83983 
84121 
84211 


84317 
84431 
84509 
84653 
84751 


84871 
85021 
85109 
85229 
85361 


85453 
85597 
85669 
85819 
85931 


86083 
86183 
86287 
86369 
86467 


86579 
86729 
86857 
86981 
87107 


87221 
87317 
87443 
87547 
87631 


87719 
87833 
87959 
88069 
88241 


88397 
88523 
88663 
88799 
88867 


88997 
89083 
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90397 
90511 


89137 
89269 
89393 


89501 
89597 
89671 
89819 
89917 


90011 
90089 
90199 
90313 
90437 


90533 
90677 
90821 
90917 
91079 


91153 
91253 
91381 
91463 
91591 


91757 
91867 
91969 
92111 
92221 


92333 
92399 
92503 
92639 
92707 


92801 
92899 
93047 
93133 
93251 


93329 
93481 
93559 
93719 
93887 


93967 
063 
201 


95089 
95191 
95273 


89153 
89273 
89399 


89513 
89599 
89681 
89821 
89923 


90017 
90107 
90203 
90353 
90439 


90547 
90679 
90823 
90931 
91081 


91159 
91283 
91387 
91493 
91621 


91771 
91873 
91997 
92119 
92227 


92347 
92401 
92507 
92641 
92717 


92809 
92921 
93053 
93139 
93253 


93337 
93487 
93563 
93739 
93889 


93971 
94079 
94207 
94327 
94433 


94541 
94621 
94777 
94849 
94999 


95093 
95203 
95279 


89413 


89519 
89603 
89689 
89833 
89939 


90019 
90121 
90217 
90359 
90469 


90583 
90697 
90833 
90947 
91097 


91163 
91291 
91393 
91499 
91631 


91781 
91909 
92003 
92143 
92233 


92353 
92413 
92551 
92647 
92723 


92821 
92927 
93059 
93151 
93257 


93371 
93491 
93581 
93761 
93893 


93979 
94099 
94219 
94331 
94439 


94543 
94649 
94781 
94873 
95003 


95101 
95213 
95287 


89417 


89521 
89611 
89753 
89839 
89959 


90023 
90127 
90227 
90371 
90473 


90599 
90703 
90841 
90971 
91099 


91183 
91297 
91397 
91513 
91639 


91801 
91921 
92009 
92153 
92237 


92357 
92419 
92557 
92657 
92737 


92831 
92941 
93077 
93169 
93263 


93377 
93493 
93601 
93763 
93901 


93983 
94109 
94229 
94343 
94441 


94547 
94651 
94789 
94889 
95009 


95107 
95219 
95311 


EJ 
95401 954 
95483 9550 


3 
7 95531 
95603 95617 95629 
95723 95731 95747 
95813 95819 95869 
95929 95947 95959 

3 

9 

3 


96017 96043 9605 96079 


96179 96181 9619 96221 
96281 96289 9629 96329 
96419 96431 96443 96457 
96497 96517 96527 96557 
96661 96667 96671 96697 96703 


96763 96769 96779 96787 96797 
96851 96857 96893 96907 96911 
96989 96997 97001 97003 97007 
97117 97127 97151 97157 97159 
97231 97241 97259 97283 97301 


97379 97381 97387 97397 97423 
97499 97501 97511 97523 97547 
97579 97583 97607 97609 97613 


97729 97771 97777 97787 97789 
97849 97859 97861 97871 97879 


97961 97967 97973 97987 98009 
98081 98101 98123 98129 98143 
98251 98257 98269 98297 98299 
98369 98377 98387 98389 98407 
98459 98467 98473 98479 9849 


98563 98573 98597 98621 98627 
98711 98713 98717 98729 9873 
98809 98837 9884 98867 98869 
98909 98911 9892 98929 98939 
98999 99013 990 99023 9904 


99109 99119 9913 99133 99137 
99223 99233 9924 99251 99257 
99349 99367 9937 99377 9939 
99469 99487 9949 99523 99527 
99577 99581 9960 99611 99623 


99707 99709 997 99719 9972 
99809 99817 99823 99829 99833 
99901 99907 99923 99929 99961 
99991 100003 100019 100043 100049 100057 100069 100103 


2.4.13 FACTORIZATION TABLE 


The following is a list of the factors of numbers up to and beyond 1,000. When a 
number is prime, it is shown in a bold face font. 


5 2.3 
2-5 11 22.3 13 27 3.5 2! 17 2.32 
22.5 3.7 211 23 29.3 52 2.13 33 22.7 
2.3.5 31 25 3.11 2-17. 5.7 22.32 37 2.19 
23.5 41 2.3.7 43 22.11 32.5 2.28 47 24.3 


2.5? 3.17 22.13 53 2.3? 5.11 23.7 3.19 2.29 
22.3.5 61 2.31 32.7 26 5.13 2-3-11 67 22.17 
2.5.7 71 23.32 73 2.37 3-5? 22.19 7.11 2.3.13 
24.5 34 2-41 83 22.3.7 5.17 2.43 3-29 23-11 
2.32.5 7.13 22.23 3-31 2.47 5.19 25.3 97 2.72 
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2.3.17 
337 24.7 
112 2-61 
131 22.3.11 
3.47 2.1 
151 23.19 
7.23 2.34 
37-19 22.43 
181 2.7-13 
191 26.3 
3.67 2-101 
211 22.53 
13.17 2-3-37 
3.7.11 23.29 
241 2.117 
251 22.32.7 
32.20 2.131 
271 24.17 
281 2.3.47 
3-97 22.73 
7-43 — 2.151 
311 23.3.13 
3-107 2.7.23 
331 22.83 
11.31 2.32.19 
33.13 25.11 
192 2.181 
7-53 22.3.31 
3-127 2-191 
17-23 23.72 
401 2-3-67 
3-137 22.103 
22.3.5.7 421 2.211 
2.5.43 431 24.38 
23.5.11 32.72 2-13-17 
2.32.52 11.41 22.113 
22.5.23 461 2-3-7-11 
2.5.47 3-157 23.59 
25.3.5 13-37 2-241 
2-5-72 491 22.3.41 
22.53 3.167 2.251 
2.3.5.17 7.73 29 
23.5.13 521 2.32.29 
2.5.53 32.50 22.7.19 
22.38.5 541 2.271 
2.52.11 19-29 23.3.23 
21.5.7 3-11-17 2-281 
2-3-5-19 571 22.11-13 
22.5.99 7.83 2.3.97 
2.5.59 3-197 24.37 
23.3.5? 601 2-7-43 


3-101 
313 
17-19 
32-37 
73 
353 
3.117 
373 
383 
3-131 
13-31 
7-59 
32.47 
433 
443 
3-151 
463 
11.43 
3-7-23 
17-29 
503 
33.19 
523 
13-41 
3-181 
7-79 
563 
3-191 
11-53 
593 
32.67 


13-47 22.32.17 613 
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22.3.17 5-41 
2.107 5-43 
25.7 32.52 
2.32.13 5.47 
22.61 5.7? 
2-127 3-5-17 
23.3.11 5-53 
2-137 5241 
22.71 3.5.19 
2.3.72 5.59 
24.19 5.61 
2.157 32.5.7 
22.31 52.13 
2.167 5:67 
23.43 3.5.23 
2.3.59 5.71 
22.7.13 5.73 
2-11-17 3.53 
27.3 5.7.11 
2-197 5.79 
22.101 34-5 
2.32.23 5.83 
23.53 52.17 
2.7-31 3.5.29 
22.3.37 5-89 
2.227 5.7.13 
24.29 3.5.31 
2.3.79 52.19 
22.112 5.97 
2-13-19 32.5.11 
23.32.7 5.101 
2.257 5.103 
22.131 3.52.7 
2.3.89 5-107 
25.17 5.109 
2.277 3.5.37 
22.3.47 5.113 
2-7-41 52.23 
23.73 — 32.5.13 
2.33.11 5-7-17 
22.151 5-11? 
2.307 3-5-41 


2-53 
22.29 
2.32.7 
23.17 
2-73 
22.3.13 
2-83 
24.11 
2.3.31 
22.72 
2.103 
23.33 
2.113 
22.59 
2.3.41 
98 
2.7.19 
22.3.23 
2-11-13 
23.37 
2.32.17 
22.79 
2.163 
24.3.7 
2.173 
22.89 
2.3.61 
23.47 
2.193 
22.32.11 
2.7.29 
25.13 
2.3.71 
22.109 
2.223 
23.3.19 
2.233 
22.7.17 
2.35 
24.31 
2-11-23 
22.3.43 
2.263 
23.67 
2.3.7.13 
22.139 
2.283 
26.32 
2.293 
22.149 
2-3-101 
23.7.11 


13-29 
32.43 
397 
11.37 
3-139 
7-61 
19-23 
3-149 
457 
467 
32.53 
487 
7-71 
3-13? 
11-47 
17-31 
3-179 
547 
557 
34.7 
577 
587 
3-199 
607 
617 


4 
2-311 7.80 2%.3.13 5 2.313 3-11-19 22.157 17.37 
631 23.79 3.211 2-317 5-127 22.3.53 72-13 2.11.29 32.71 
641 2.3.107 643 22.7.23 3.5.43 2-17-19 647 23.34 11-59 
3-7-31 27-163 653 2.3-109 5-131 24-41 32.73 2-7-47 659 
661 2-331 3-13-17 23.83 5.7.19 2.32.37 23-29 27-167 3-223 
11-61 25.3.7 673 2.337 33.52 92.132 677 2-3-113 7.97 
3.227 2-11-31 683 22.32.19 5.137 2.73 3.229 24.43 13-53 
691 22.173 32.7.11 2-347 5.139 23.3.29 17-41 2-349 3.233 
701 2.33.13 19.37 29.11 3.5.47 2-353 7-101 27-3-59 709 
32.70 28.89 23-31 2.3-7-17 5-11-13 22.179 3.239 2.359 719 
7.103 2-19? 3.241 27-181 52.29 2-3-11? 727 23.7.13 36 
17.43 22.3.61 733 2.367 3.5.72 25.293 11.67 2.32.41 739 
3-13-19 2.7.53 743 23.3.31 5-149 2-373 32.83 22.11-17 7-107 
751 24.47 3.251 2-13-29 5.151 92.33.7 757 2.379 3-11-23 
761 2.3.127 7-109 22.191 32.5.17 2.383 13-59 28.3 769 
3-257 22.193 773 2.32.43 52.31 23.97 3.7.87 2.389 19-41 
11.71 2-17-23 39.29 24.72 5.157 2-3-131 787 22.197 3.263 
7.113 28.32.11 13-61 2-397 3.5.53 22.199 797 2-3-7-19 17-47 
32.80 2.401 11.73 22.3.67 5.7.23 2-13-31 3-269 23.101 809 
811 22.7.29 3.271 2.11.37 5:163 24.3.17 19-43 2-409 32.7.13 
821 2.3.137 823 23.103 3.52.11 2.7.59 827 22.32.23 829 
3.277 29.13 72.17 2.3.139 5.167 22.11.19 33.31 2.419 839 
29? 2.421 3.281 22.211 5.132 2.32.47 7.112 24.53 3.283 
23-37 — 22.3.71 853 2-7-61 32.5.19 23.107 857 2-3-11-13 859 
3-7-41 2-431 863 25:33 5.173 2-433 337 22.7.31 11.79 
13-67 23.109 37.07 2.19.23 53.7  2?.3.73 877 2-439 3-293 
881 2.32.72 883 22.13.17 3.5.59 2.443 887 23.3.37 7-127 
31.11 22.223 19.47 2.3.149 5-179 27.7 3-13-23 2-449 29-31 
17-53 2-11-41 3.7.43 23.113 5.181  2.3.151 907 92.227 32.101 
911 24.3-19 11-83 2-457 3-5-61 22.229 7.131 2-33-17 919 
3.307 2-461 13.71 22.3.7.11 52.37 2.463 32.103 25.29 929 
72.10 27.233 3.311 2-467 5-11-17 23.32.13 937 2.7.67 3-313 
941 2-3-157 23-41 24.59 33.5.7 2-11-43 947 22.3.70 13-73 
3.317 — 23.7.17 953 2.32.53 5.191 22.239 3-11-29 2.479 7-137 
317 2.13.37 32.107 27-241 5.193 2-3-7-23 967 23.11? 3.17.19 
971 22.35 7-139 2-487 3-52-13 24.61 977 2-3-163 11-89 
32.109 2-491 983 23.3.41 5-197 2-17-29 3.7.47 22.13.19 23.43 
2-32.5-11 991 25-31 3-331 2-7-71 5-199 22.3.83 997 2.499 33.37 
23.53 7-11-13 2.3.167 17-59 22.251 3.5.67 2.503 19.53 24.32.7 1009 
2.5.101 3-337 22.11.23 1013 2.3.132 5.7.29 23-127 32.113 2-509 1019 
22.3.5.17 1021 2.7.73 3.11.31 219 52.41 2.38.19 13.79 22.257 3.73 
2.5.103 1031 28.3.43 1033 2-11-47 32.5.23 22.7.37 17-61 2-3-173 1039 
24.5.13 3.347 2-521 7-149 22.32.29 5-11-19 2.523 3-349 28.131 1049 
2.3.52.7 1051  2?.263 34.13 2.17.3 5:211 25.3.11 7.151 2.23? 3-353 
22.5.53 1061 2-37-59 1063  2%.7.19 3-5-71 2-13-41 11-97  2?.3.89 1069 
2.5-107 — 32.7.17 24-67 29-37 2.3.179 52.43 22.269 3-359 2.72.11 13-83 
23.38.5 23.47 2.541 3.19? 22.271 5.7.31 2-3-181 1087 26.17 32.117 
2-5-109 1091 22.3.7.13 1093 2.547 3.5.73 23.137 1097 2.32.61 7.157 
22.52.11 3.367 2-19-29 1103 25.3.23 5.13.17 2.7.79 33.41 22.277 1109 
2.3-5-37 11-101 23.139 3.7.53 2.557 5.223 22.32.31 1117 2.13.43 3.373 
25.5.7 19.59 2-3-11-17 1123 22.281 32.53 2.563 77.23 23.3.47 1129 
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2.4.14 FACTORIZATION OF 2? — 1 


23—1-7 219 — 1 — 524287 
2aleix5 220 —_ 1 =3x 5? x 11x31x41 
25—1=31 DU — 1 = 7? x 127 x 337 

26 —1=3 x7 222 — 1 = 3 x 23 x 89 x 683 
27—1=127 2?3 — 1 = 47 x 178481 


28—1=3x5x17 2?4—1=3?x 5x7 x13 x 17x 241 
29—1=7x73 2?5 — 1 = 31 x 601 x 1801 
20 2T =3 x 11 x31 226 — 1 = 3 x 2731 x 8191 


211 — 1 = 23 x 89 2?°7 — 1 =7 x 73 x 262657 
212—1=3?x5x7x13 |2?8—1=3x 5x 29x 43x 113 x 127 


213 — 1 = 8191 229 — 1 = 233 x 1103 x 2089 

214 — 1 = 3 x 43 x 127 2:5 — 1 = 3? x 7 x 11 x 31 x 151 x 331 
215 — 1 =7 x 31 x 151 231 — 1 = 2147483647 

216 — 1 = 3 x 5 x 17 x 257 | 23? — 1 = 3 x 5 x 17 x 257 x 65537 
217 — 1 = 131071 233 — 1 = 7 x 23 x 89 x 599479 


218 — 1 = 383 x 7x 19 x 73 | 234 — 1 = 3 x 43691 x 131071 


2.4.15 EULER TOTIENT FUNCTION 
2.4.15.1 De nitions 


1. ф(п) the totient function is the number of integers not exceeding and 
relatively prime to n. 

) isthe sum of the divisors of n. 

3. T(n) 15 ће number of divisors of n. (Also called the d(n) function.) 


Dene о,(п) to be the k“ divisor function, the sum of the k“ powers of the 
divisors of n. Then T(n) = co(n) and a(n) = oi (n). 


EXAMPLE The numbers less than 6 and relatively prime to 6 are (1, 5}. Hence ф(6) = 
2. The divisors of 6 are (1,2,3,6]. There are 7(6) — 4 divisors. The sum of these 


numbers is o(6) =1+2 +3 +6 = 12. 


2.4.15.2 Properties of the totient function 
1. $ is a multiplicative function: if (n, m) = 1, then ф(пт) = ф(т)ф(п). 


2. If pis prime, then ф(р) = p — 1. 
3. Gauss's theorem states: n = У. ó(d). 


4. When n = TI, pf“, and the {p;} are prime 


k(oi--1) 


z d* -11———. (2.4.17) 
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5. Generating functions 


Е i8 (8-1) дэ 
з сыш: = 


6. A perfect number n satises c(n) = 2n. The integer n is an even perfect 
number if, and only if, n = 27171(2" — 1), where m is a positive integer such 
that Mm = 2" — 1 is a Mersenne prime. The sequence of perfect numbers is 
16, 28, 496, ... + (see page 31), corresponding to m = 2, 3, 5, .... It is not 
known whether there exists an odd perfect number. 


2.4.15.3 Table of totient function values 


UR оошо 


- 


к. 


к. 


ка = 


= 


4 
6 
5 
6 
8 
6 
6 
9 
8 
6 
0 
6 
8 
2 
7 
6 
2 
6 
0 
2 
8 
6 
2 
9 
8 


СО МЮ & мю хл ыры ыс NBN 
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= 


і 


= 
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(n) c 
3 
4 
4 
4 
2 
4 
4 
2 
6 
2 
4 
8 
3 
2 
4 
2 
4 
8 
2 
2 
4 
4 
4 
4 
4 
4 
9 
2 
2 
4 
2 
6 
4 
4 
2 
6 
4 
2 
8 
2 
2 
8 
3 
2 
8 
4 
4 
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2.5 VECTOR ALGEBRA 


2.5.1 NOTATION FOR VECTORS AND SCALARS 


A vector is an ordered n-tuple of values. A vector is usually represented by a lower- 
case, bold-faced letter, such as v. The individual components of a vector v are typ- 
ically denoted by a lower-case letter along with a subscript identifying the relative 
position of the component in the vector, such as v = [v1, v», .. . , v4]. In this case, 
the vector is said to be n-dimensional. If the n individual components of the vector 
are real numbers, then v € К”. Similarly, if the n components of v are complex, 
then v € C^. 

Subscripts are also typically used to identify individual vectors within a set of 
vectors all belonging to the same type. For example, a set of n velocity vectors can 


be denoted by fv1,..., уһ }. In this case, a bold-face type is used on the individual 
members of the set to signify these elements of the set are vectors and not vector 
components. 


Two vectors, v and u, are said to be equal if all their components are equal. The 
negative of a vector, written as —v, is one that acts in a direction opposite to v, but is 
of equal magnitude. 


2.5.2 PHYSICAL VECTORS 


Any quantity that is completely determined by its magnitude is called a scalar. For 
example, mass, density, and temperature are scalars. Any quantity that is completely 
determined by its magnitude and direction is called, in physics, a vector. We often 
use a three-dimensional vector to represent a physical vector. Examples of physical 
vectors include velocity, acceleration, and force. A physical vector is represented by 
a directed line segment, the length of which represents the magnitude of the vector. 
Two vectors are said to be parallel if they have exactly the same direction, 1.e., the 
angle between the two vectors equals zero. 


2.5.3 FUNDAMENTAL DEFINITIONS 


1. A row vector is a vector whose components are aligned horizontally. A column 
vector has its components aligned vertically. The transpose operator, denoted 
by the superscript T, switches the orientation of a vector between horizontal 
and vertical. 
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EXAMPLE 


1 
2 
ү-|,2,3,4, Vel, (v')' =[1,2,3,4]. 
4 
row vector column vector row vector 


Vectors are traditionally written with either parentheses or with square brack- 
ets. 


2. Two vectors, v and u, are said to be orthogonal if vu = 0. (This is also 


written v : u = 0, where the “-" denotes an inner product; see page 133.) 


3. A set of vectors {v1,..., Vn} is said to be orthogonal if v1 v; = 0 for alli 4 j. 


4. A set of orthogonal vectors {v1,..., Vm } is said to be orthonormal if, in addi- 


tion to possessing the property of orthogonality, the set possesses the property 
that v;'v; = 1 forall 1 < i < m. 


2.5.4 LAWS OF VECTOR ALGEBRA 


1. 


The vector sum of v and u, represented by v + u, results in another vector of 
the same dimension, and is calculated by simply adding corresponding vector 
components, e.g., if vyu € R”, then v + u = [vy + U1,...,Un + Un]. 


The vector subtraction of u from v, represented by v — u, is equivalent to the 
addition of v and —u. 


If r > 0 is a scalar, then the scalar multiplication rv (equal to vr) represents 
a scaling by a factor r of the vector v in the same direction as v. That is, the 
multiplicative scalar is distributed to each component of v. 


If 0 <r < 1, then the scalar multiplication of r and v shrinks the length of v, 
multiplication by r = 1 leaves v unchanged, and, if r > 1, then rv stretches 
the length of v. When r < 0, scalar multiplication of r and v has the same 
effect on the magnitude (length) of v as when r > 0, but results in a vector 
oriented in the direction opposite to v. 


If r and s are scalars, and v, u, and w are vectors, the following rules of algebra 
are valid: 
v+u=u+V, 
(r + в)у = rv + sv = vr + vs = v(r + s), 
(2.5.1) 
т(у + и) = rv 4 ru, 


v+(u+w) =(v+u)+w=v+u-4w. 
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2.5.5 VECTOR NORMS 


1. A norm is the vector analog to the measure of absolute value for real scalars. 
Norms provide a distance measure for a vector space. 


2. A vector norm applied to a vector у is denoted by a double bar notation ||у||. 
(Single bar notation, |У|, is also sometimes used). 


3. A norm on a vector space equips it with a metric space structure. 
4. The properties of a vector norm are: 


(a) For any vector v Z 0, ||v|| > 0, 
(b) |lyvll = [x] 1М|, and 


(c) ||v + ul] € ||v|| + ||u|| (triangle inequality). 
5. The three most commonly used vector norms on R” or C” are 


(a) The Lı norm is de ned as ||v||, = |vi| +--+ + Jun] = Moi |01. 


(b) The Lə norm (Euclidean norm) is de ned as 


n 1/2 
lvl = (w1 |? + [vl + + val)? = (>: 2 u (2.5.2) 
121 


(с) The 1. norm is de ned as | . = pat lvi]. 


6. In the absence of any subscript, the norm |]-|| is usually assumed to be the Lə 
(Euclidean) norm. 


7. A unit vector with respect to a particular norm || || is a vector that satis es the 
property that ||v|| = 1, and is sometimes denoted by v. 


2.5.6 DOT, SCALAR, OR INNER PRODUCT 


1. The dot (or scalar or inner product) of two vectors of the same dimension, 
represented by v · u or vu, has two common de nition s, depending upon the 
context in which this product is encountered. 


(a) In vector calculus and physics, the dot or scalar product is de ne d by 
уги = [|v|| ||| cos, (2.5.3) 


where @ represents the angle between the vectors v and u. 
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(b) In optimization, linear algebra, and computer science, the inner product 


of two vectors, u and v, is eguivalently de ned as 


n 
T 
u У = > UjVi = U1V1 +++ H Unn. 


4-1 


(2.5.4) 


From the rst de nition , it is apparent that the inner product of two perpendic- 


ular, or orthogonal, vectors is zero, since the cosine of 90° is zero. 


. The inner product of two parallel vectors (with u = rv) is given by v. u = 


r |У. For example, when r > 0, 


2 
уга = ||у|| ||| cosO = ||у[| [ul] = [v] levi] = rv: 


. The dot product is distributive, e.g., 
(v+u):-w=v-w+u-w. 


. Богу, и, w € R” with n > 1, 


However, 1t is valid to conelude that 


ути = vw > v! (u — w) = 0, 


i.e., the vector v is orthogonal to the vector (u — w). 


FIGURE 2.1 
Depiction of right-hand rule. 


V4 X V2 


v2 


V4 
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(2.5.5) 


(2.5.6) 


(2.5.7) 


(2.5.8) 


2.5.7 VECTOR OR CROSS PRODUCT 


1. The vector (or cross product) of two non-zero three-dimensional vectors v and 
u is de ned as 


vx u = f ||v||||u|| sin 8, (2.5.9) 


where fi is the unit normal vector (i.e., vector perpendicular to both v and u) 
in the direction adhering to the right-hand rule (see Figure 2.1) and 0 is the 
angle between v and u. 


2. If v and u are parallel, then v x u = 0. 


3. The quantity ||v|| ||u|| [sin 9| represents the area of the parallelogram deter- 
mined by v and u. 


4. The following rules apply for vector products: 


(уу) х (au) = (уа)у x u, 
vxu--uxy, 

vx(u+w) —vxu+vx у, 

(v+u)xXw=vxw+uxw, (2.5.10) 

v x (ux w) = u(w. v) — w(v-u), 

(ухи): (w x z) = (v: w)(u-z) — (v-z)(u- w), 

(ухи) x (w x z) = [v- (u x z)w — [v: (u x w)]z 
= [v- (w x z) lu — [u + (w x z)]v. 


5. The pairwise cross products of the unit vectors i, i and k, corresponding to the 
directions of v = vii + vaj + v3k, are given by 


іхј= -(j x1) =k, 
j x k = —(k x j) =i, 
ү A 0 3 x (2.5.11) 
k x i = —(i x k) =j, and 
ixi іхі kxk = 0. 
6. If = vii + vaj + vzk and u — uli + ио] + usk, then 
i j k 
VXU— |v V2 U3 
ui. dis “йз (2.5.12) 


= (vous — 1263) + (озш — ugv1)j + (v1u» — 017313 
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2.5.8 SCALAR AND VECTOR TRIPLE PRODUCTS 


1. The scalar triple product involving three three-dimensional vectors v, u, and 
w, sometimes denoted by [vuw] (not to be confused with a matrix containing 
three columns [v u w] ), can be computed using the determinant 


U2 481: ui Чз|$ uj шр 
Мам) = v. (ux w) = у: 311- 311-- К 
Шо %3 wj W3 wj шә 
мә из U1 из U1 usa 
= 01 — v2 + U3 
409 Шз W1 Usa шу W2 


=|и u2 Ua (2.5.13) 
W1 Шә 103 


lol] [lel] |Іші cos p sin 6, 


where 0 is the angle between u and w, and © is the angle between v and the 
normal to the plane de ned by u and w. 


2. The absolute value of a triple scalar product calculates the volume of the par- 
allelepiped determined by the three vectors. The result 1s independent of the 
order in which the triple product is taken. 


3. (vx u) x (w x z) = [vwzju — [uwz|v = [vuz|w — [vuw]z. 


4. The vector triple product involving three three-dimensional vectors v, u, and 
w, given by v x (u x w), results in a vector, perpendicular to v, lying in the 
plane of u and w, and is de ned as 


v x (ux w) = (у: w)u — (v: u)w, 

i j k 

" fm M (2.5.14) 
U2 из ` 
шә W3 


из (721 
Шз Ш 


uj U2 
Ші W2 


5. Given three non-coplanar reference vectors v, u, and w, the reciprocal system 
is given by v*, u*, and w*, where 


Жама po. а . (2.5.15) 
[vuw] [vuw] [vuw] 
Note that 
l=v-v*=u-u* 
(2.5.16) 


and 0=v-u* =v-w* —u-v“, etc. 


The system i, 1, k is its own reciprocal. 
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2.6 


2.6.1 


10. 


11. 


12. 


LINEAR AND MATRIX ALGEBRA 


DEFINITIONS 


. An m x m matrix is a two-dimensional array of numbers consisting of m rows 


and n columns. By convention, a matrix is denoted by a capital letter empha- 
sized with italics, as in А, B, D, or boldface, A, B, D. Sometimes a matrix 
has a subscript denoting the dimensions of the matrix, e.g., 42343. If A isa 
real n х m matrix, then we write А Є "х", Higher dimensional matrices, 
although less frequently encountered, are accommodated in a similar fashion, 
e.g., a three-dimensional matrix Amn xp, and so on. 


Amxn is called rectangular if m £ n. 
Amxn is called square if m = n. 


A particular component (equivalently: element) of a matrix is denoted by the 
lower-case letter of that which names the matrix, along with two subscripts 
corresponding to the row 2 and column 7 location of the component in the 
array, e.g., 


Amxn ав components aij; 


Bin has components bj; . 


For example, a23 is the component in the second row and third column of 
matrix А. 


Any component аг, with i = j is called a diagonal component. 


The diagonal alignment of components in a matrix extending from the upper 
left to the lower right is called the principal or main diagonal. 


Any component a;; with 7 Z j is called an off-diagonal component. 


Two matrices А and B are said to be equal if they have the same number of 
rows (m) and columns (n), and aj; = bj; forall 1 <i <m, 1< j <n. 


An m x 1 dimensional matrix 1s called a column vector. Similarly, a 1 X n 
dimensional matrix is called a row vector. 


A column (row) vector with all components equal to zero is called a null vector 
and is usually denoted by 0. 


A column vector with all components equal to one is often denoted by e. The 
analogous row vector is denoted by eT. 


The standard basis consists of the vectors {e1 , €2,. . . , €n } where e; і ann x 1 
vector of all zeros, except for the 1% component, which is one. 
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13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


The scalar x'x = У)? , 2? is the sum of squares of all components of the 
vector x. 


The weighted sum of squares is de ned by x" Dy x = 35; wix?, when x has 
n components and the diagonal matrix D, is of dimension (n x n). 


If Q is a square matrix, then xT Qx is called a quadratic form. 


An n x n matrix А is called non-singular, or invertible, or regular, if there 
exists an n x n matrix B such that AB = BA = I. The unique matrix В 
satisfying this condition is called the inverse of A, and is denoted by A ~t. 


The scalar x"y = pem Ziyi, the inner product of x and у, is the sum of 
products of the components of x by those of y. 


The weighted sum of products is xT Dy = 3o ша, When x and y have 
n components, and the diagonal matrix D w is (n x n). 


The map x -» xTQy is called а bilinear form, where Q is a matrix of appro- 
priate dimension. 


The transpose of an m x n matrix А, denoted by AT, is an n x m matrix with 
rows and columns interchanged, so that the (i, 7) component of A is the (7,4) 
component of AT, and (АТ): = (4);j = aij. 


The Hermitian conjugate of a matrix A, denoted by АН, is obtained by trans- 
posing А and replacing each element by its complex conjugate. Hence, if 
аы = иы + #0, then (АН), = Uk — Wik, With i = V—1. 


If Q is a square matrix, then the map x ^ хіх is called a Hermitian form. 


2.6.2 TYPES OF MATRICES 


1. 


2. 
3. 


4. 


A sguare matrix with all components off the principal diagonal egual to zero 
is called a diagonal matrix, typically denoted by the letter D with a subscript 
indicating the typical element in the principal diagonal. 


EXAMPLE 
(ан 0 0 | [^u 0 0 ] 
Da = 0 23 0 , Dy = 0 Хә 0 5 
| 0 0 ааа | 0 0 ds] 
A zero, or null, matrix is one whose elements are all zero (notation is *0"). 


The identity matrix, denoted by I, is the diagonal matrix with a;; — 1 for all 
i = j, and aj; = 0 fori Z j. Then x n identity matrix is denoted Iņ. 


The elementary matrix, Ej, is de ned differently in different contexts: 


(a) Elementary matrices have the form E,j = егет. Hence, A = У,у, j 04) Pij. 
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(b) Elementary matrices are also written as E = I — auv', where I is the 
identity matrix, a is a scalar, and u and v are vectors of the same dimen- 
sion. In this context, the elementary matrix is referred to as a rank-one 
modi ca tion of an identity matrix. 


(c) In Gaussian elimination, the matrix that subtracts a multiple £ of row j 
from row 4 is called Ej; = I — (еге), with 175 on the diagonal and the 
number —/ in row i column 7. 


EXAMPLE 
1 0 0 0 
Е т |0 100 
E31 = I — безе, = -8 0 1 0 
0 0 0 1 


5. A matrix with all components above the principal diagonal egual to zero is 
called a lower triangular matrix. 


EXAMPLE 


А = |a» a» 0 1s lower triangular. 


6. A matrix with all components below the principal diagonal egual to zero is 
called an upper triangular matrix. (The transpose of a lower triangular matrix 
1s an upper triangular matrix.) 


7. A matrix whose components are arranged in m rows and a single column is 
called a column matrix, or column vector, and is typically denoted using bold- 
face, lower-case letters, e.g., a and b. 


8. A matrix whose components are arranged in n columns and a single row is 
called a row matrix, or row vector, and is typically denoted as a transposed 
column vector, e.g., aT and b”. 


9. A square matrix is called symmetric if A — AT. 
10. A square matrix is called skew symmetric if АТ = — A. 


11. A square matrix A is called Hermitian if A = АН. A square matrix A is called 
skew-Hermitian if АН = — A. All real symmetric matrices are Hermitian. 


12. A square matrix Q with orthonormal columns is said to be orthogonal.! It 
follows directly that the rows of Q must also be orthonormal, so that QQ? = 
ОТО = I, or QT = Q-!. The determinant of an orthogonal matrix is +1. 


A rotation matrix is an orthogonal matrix whose determinant is equal to 4-1. 


13. An m x n matrix A with orthonormal columns has the property AT A = Г. 


! Note the inconsistency in terminology that has persisted. 
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14. 


15. 


16. 
17. 


18. 


19. 


20. 


21. 


22. 


23. 


A sguare matrix is called unitary if АНА = Т. A real unitary matrix is or- 
thogonal. The eigenvalues of a unitary matrix all have an absolute value of 
one. 


A square matrix is called a permutation matrix if its columns are a permutation 
of the columns of J. A permutation matrix is orthogonal. 


A square matrix is called idempotent if AA = A? = A. 


A square matrix is called a projection matrix if it is both Hermitian and idem- 
potent: АН — A? = A. 


A square matrix is called normal if АН А = ААН. The following matrices are 
normal: diagonal, Hermitian, unitary, skew-Hermitian. 


A square matrix is called nilpotent to index k if A“ = 0 but A*-! Æ 0. The 
eigenvalues of a nilpotent matrix are all zero. 


A principal sub-matrix of a symmetric matrix A is formed by deleting rows 
and columns of A simultaneously, e.g., row 1 and column 1; row 9 and column 
9, etc. 


A square matrix whose elements are constant along each diagonal is called a 
Toeplitz matrix. 


EXAMPLE 


аа е 4 0 1 
22525) 42798) апа М=|—11 4 0 (2.6.1) 
c b а —11 4 


are Toeplitz matrices. Notice that Toeplitz matrices are symmetric about a 
diagonal extending from the upper right-hand corner element to the lower left- 
hand corner element. This type of symmetry is called persymmetry. 


A Vandermonde matrix is a square matrix V Є RUD XU in which each 


column contains unit increasing powers of a single matrix value: 


01 v2 nm дааа) 
v? v2 ... 1) 

V= |” %2 (n+1) |. (2.6.2) 
vý vs nm Unt) 


A square matrix U is said to be in upper Hessenberg form if u ;; = 0 whenever 
i > 7+1. An upper Hessenberg matrix is essentially an upper triangular matrix 
with an extra non-zero element immediately below the main diagonal entry in 
each column of U. For example, 


U11 U12 U13 U14 

re baj u22 u23 U24 
О b32 изз U34 

0 0 bas U44 


is upper Hessenberg. 
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24. If the sum of the components of еасһ column of a matrix A € R"“" eguals 
one, then A is called a Markov matrix. 


25. A circulant matrix 15 an n X n matrix of the form 


Co C1 C2 ''' Cn—2  Cn—1 
Cn—1 Co Сі ''' €n—3 Cn—2 
C= |би-2 ба-1 60 5550 Cn-4 Cn-3|, (2.6.3) 
сі C2 C3 0335 Cn—1 Co 


where the components с;; are such that (j — i) = k mod n have the same 
value c. These components comprise the k" stripe of С. 


26. A matrix А = (aj) has lower bandwidth p if a;; = 0 whenever i > j + p and 
upper bandwidth g Ға; = 0 whenever j > i + g. When they are equal, they 
are the bandwidth of A. A diagonal matrix has bandwidth 0. A tridiagonal 
matrix has bandwidth 1. An upper (resp. lower) triangular matrix has upper 
(resp. lower) bandwidth of n — 1 (resp. m — 1). 


а а а 
27. If а rotation is de ned by the matrix A = аза a23 | then its x ed axis of 
31 432 433 


rotation is given by v = i(a23 — азә) + j(as1 — a13) + k(a12 — a21). 


28. A Householder transformation, or Householder re ection , 18 an n x n matrix 
H of the form Н = T — (2uu!)/(u"u), where the Householder vector u € R” 
1s non-zero. 


20. A Givens rotation is de ned as a rank-two correction to the identity matrix 


given by 
! e 0 0 0) 
O œ с 8 0| 4 
Сї, 5,0) = |: хе 
0... —s с 0| k си 
0. 0 0 1 
4 k 
where c = cos@ and s = sin$ for some angle 9. Premultiplication by 


G (i, 5,0)" induces a counterclockwise rotation of 9 radians in the (i, k) plane. 
For x € R” and y = G(i, Е, 6) х, the components of y are given by 


ст; - Szk, forj —1 
Yj = 4 szi + стр, forj—k (2.6.5) 
ті, for j Z i, К. 
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2.6.3 CONFORMABILITY FOR ADDITION AND 
MULTIPLICATION 


1. Two matrices A and B can be added (subtracted) if they are of the same di- 
mension. The result is a matrix of the same dimension. If C — A + B then 
Cij = Qij + bij. 


EXAMPLE 


3 2 eds ПЕТ Паш 2 
Anat Bos = | 0 220 1 lek 1 Al 


2. Multiplication of a matrix or a vector by a scalar is achieved by multiplying 
each component by that scalar. If B = a A, then bj; = «aj; for all compo- 
nents. 


3. The matrix multiplication AB is de ned if the number of columns of A is 
equal to the number of rows of B. 


4. The multiplication of two matrices A mxn and By xg results in a matrix Cm xg 
whose components are de ne d as 


n 
са-У ainda; (2.6.6) 
k=1 


fori = 1,2,...,m and j = 1,2,...,q. Each с;; is the result of the inner (dot) 
product of the i" row of A with the j column of B. 


шинжин | | и 


| [^ 


j* column of B 


^ row of A (ij) element of C 


st 
1 


This гше applies similarly for matrix multiplication involving more than two 
matrices. If ABCD = E then 


ез = УУ У бшбыбтйт. (2.6.7) 
k l m 


The second subscript for each matrix component must coincide with the rst 
subscript of the next one. 


EXAMPLE 
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сл 


. In general, matrix multiplication is not commutative: АВ Z ВА. 


O 


. Matrix multiplication is associative: A(BC) = (AB)C. 


a 


. The distributive law of multiplication and addition holds: C(A + B) = CA + 
CB and (A + B)C = AC + ВС. 


8. Both the transpose operator and the Hermitian operator reverse the order of 
matrix multiplication: (АВС)! = CT BT AT and (ABC)! = CH BH AH, 


Nel 


. Strassen algorithm: 'The matrix product ап 412] [bui біз a M EM 
a21 22] |бо1 боз C21 C22 
can be computed in the following way: 


ті = (a12 — à22)(b21 + 022), Сі] = mj t m» — ma t тв, 
тә = (ац + a22) (b11 + b22), Сіз = M4 + ms, 

тз = (ау = a21)(b11 + b12), Сә = т + тт, and 

ma = (a11 + a12)022, C22 = Тә — Тз + M5 — M7. 


m5 = а11(ф12 = бээ), 
тв = a22(be1 = 81). 


mz = (a21 + a22)b11, 


This computation uses 7 multiplications and 18 additions and subtractions. 
Using this formula recursively allows multiplication of two n x n matrices 
using O(n!°82 7) = O(n?-897-—) scalar multiplications. 


10. The order in which matrices are grouped together for multiplication can change 
the number of scalar multiplications required. The straightforward number 
of scalar multiplications required to multiply matrix Х „хь by matrix Ур, с is 
abc, without using clever algorithms such as Strassen’s. For example, con- 
sider the matrix product Р = A10x100B100x505x50- The parenthesization 
P = ((AB)C) requires (10 x 100 x 5) + (10 x 5 x 50) = 7,500 scalar 
multiplications. The parenthesization Р = (A(BC)) requires (10 x 100 x 
50) + (100 x 5 x 50) = 75,000 scalar multiplications. 


11. Pre-multiplication by a diagonal matrix scales the rows 


di O +: 0 ай >t 01m diiài +++ dudum 
0 dy» 0 азу "ат @зоазу\ +++ Фәза 
0 0 dnn ац 177. (бат dnnOn1 ++: dnnúnm 


12. Post-multiplication by a diagonal matrix scales the columns 


a11 Tik алт dii 0 m 0 аал Кая атат 
021 "5 (от 0 dz 0 diraz +++ dmmGom 
Ani 020: Anm 0 0 dmm апат 05: dmmanm 
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2.6.4 DETERMINANTS AND PERMANENTS 


1. The determinant of a square matrix A, denoted by |.A| or det( 4) or det A, is 
a scalar function of A de ned as 


G11 4012 955 Gin 011 012 “Gin 
021 Q22 ‘`` (эт аі 022 ‘'' @ 
det(A) = det = 
dni Gn2 0055 Ann dni Gn2 ^''' Gnn| (2.6.8) 


= 8 
= » (-1)%а402 ** Ani, 
where the sum is taken either 


(a) over all permutations c of [1,2,...,n+ and the signum function, sgn(c), 
is (—1) raised to the power of the number of successive transpositions 
required to change the permutation c to the identity permutation; or 


(b) over all permutations 11 Z i2 Z ::- Æ in, and 6 denotes the number of 
transpositions necessary to bring the sequence (i1,12,... ,8n) back into 
the natural order (1,2,...,n). 


2. Fora 2 х 2 matrix, | 41 212 | 55011422 — 412421. 


For a3 x 3 matrix, 


G11 012 413 
21 022  023| = 411022033 + 012023031 + G13021 032 


a31 432 433 (2.6.9) 


— 0413022031 - 011023032 — 012021033. 


3. The determinant of the identity matrix is one. 
4. Note that |A| |B| = |AB| and |A| = | AT]. 


5. Interchanging two rows (or columns) of a matrix changes the sign of its 
determinant. 


6. A determinant does not change its value if a linear combination of other rows 
(or columns) is added to or subtracted from any given row (or column). 


7. Multiplying an entire row (or column) of А by a scalar y causes the determi- 
nant to be multiplied by the same scalar y. 


8. Foran n x n matrix A, |y A| = y"|A]. 


9. If det (A) = 0, then A is singular; if det (A) Z 0, then A is non-singular or 
invertible. 
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10. 
11. 


12. 


13. 


14. 


15. 


16. 


det (A71) = 1/ det (А). 


When the edges of a parallelepiped P are de ned by the rows (or columns) 
of A, the absolute value of the determinant of A measures the volume of P. 
Thus, if any row (or column) of А is dependent upon another row (or column) 
of A, the determinant of A eguals zero. 


The cofactor of a square matrix A, cof ;; (A), is the determinant of a sub-matrix 
obtained by striking the 27 row and ће 7" column of A and choosing a positive 
(negative) sign if (i + 7) is even (odd). 


EXAMPLE 


| = —(2+8) = —10. (2.6.10) 


Let ас, denote the components of A and а“? those of А-1. Then, 
a = соён(АУЛАГ (2.6.11) 


Partitioning of determinants: Let A = [8 €]. Assuming all inverses exist, 
then 


|A| = |E| |(B - CE! D)| = |B| |(E- DB™'C)|. (2.6.12) 
Laplace development: The determinant of А is a combination of row i (col- 


umn 7) and the cofactors of row (column 7), i.e., 


|A| = адсоҒд (А) + ао соЁ;ә (А) Tec AinCOL jn (A), 


2.6.13 
= a1 jcof1j (4) + a>jcofo ; (А) dee аһзсоЁ,,; (А), ( ) 
for any row à or any column 7. 


Omitting the signum function in Equation (2.6.8) yields the de nition of per- 
manent of A, given by per A = У), a1,í(1) ***@n,o(n)- Properties of the per- 
manent include: 


(a) If Ais an m x n matrix and B is ann х m matrix, then 
Iper(AB)|? < per( 44") per(B" B). (2.6.14) 


(b) If P and Q are permutation matrices, then per PAQ = per A. 
(c) If D and G are diagonal matrices, then per DAG = per D per A per G. 
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2.6.5 MATRIX NORMS 


1. The mapping g : R™*” => R is a matrix norm if g satis es the same three 
properties as a vector norm: 


(a) g(A) > 0 for all A and g(A) = 0 if and only if A = 0, so that (in norm 
notation) || A|| > 0 for all non-zero A. 

(b) For two matrices A,B € Кх", g(A + B) < g(A) + g(B), so that 
[А + Bl] < 411+ | Bl. 

(с) g(rA) = |r|g(A), where r € R, so that || А| = || |All. 


2. The most common matrix norms are the Lp matrix norm and the Frobenius 
norm. 


3. The L, norm of a matrix A is the number de ned by 


|| Ах| 
411, = sup 7 


Lm (2.6.15) 
x70 |І, 


where ||-||,, represents one of the Lp (vector) norms with р = 1,2, or оо. 


(а) The Lı norm of Am yn is de ned as ||A||, = maxi<j<n X (а. 
(b) The Г» norm of A is the square root of the greatest eigenvalue of АТА, 


(і.е., IAI = Amax( AT A)), which is the same as the largest singular 
value of A, || A|| = о (A). 


(c) The Lo norm is de ned as ||A|| = maxi<i<m Ха [ау]. 


4. The Frobenius or Hilbert-Schmidt norm of a matrix A is de ned as 


\ ЖЭЭ (2.6.16) 
121 j—1 


which satis es ШЕ = tr(AT A). Since К" is isomorphic to R™”, the 
Frobenius norm can be interpreted as the Lə norm of an пт x 1 column vector 
in which each column of A is appended to the next in succession. (See the 
Vector operation (“Уес”) in Section 2.6.17.) 


ІМІЕ- 


5. When A is symmetric, then ||А||„ = max; |А; 
ues of A. 


, where (Ху) are the eigenval- 


6. The following properties hold: 


1 
Um All, < ПА < vn [AD ; 
max Jai] < [All < V mn max |aij|, and (2.6.17) 


1 


m ІШІ. € NAM: < ут|АД,. 
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7. 


8. 


The matrix р norms satisfy the additional property of consistency, de ne d as 
ABI, < All, Bl: 


The Frobenius norm is compatible with the vector 2 norm, i.e., | Ax|| p < 
1.411, 11х11. The Frobenius norm also satis es || А||„ € || Alle 5401 Al. 


2.6.6 SINGULARITY, RANK, AND INVERSES 


1. 


л A © N 


An n x n matrix A is called singular if there exists a vector x £ 0 such that 
Ax = 0 or A!x = 0. (Note that x = 0 means that all components of x are 
Zero.) If a matrix is not singular, it is called non-singular. (This is consistent 
with note 16 on page 138.) 


. (AB)-! = B7! A-1, provided all inverses exist. 
ы = (a). 
AHA = (1/7) A~. 


. If Du, is a diagonal matrix, then Dj! = D; jw- 


0 


1022 


0 ши 


w22 


zc 
EXAMPLE ир,- D | TEL NER E | 


. Partitioning: Let A = |В ©]. Assuming that all inverses exist, then A^! = 


Х Y], where 
X=(B-CE™D)", Vs (Es<DB OJ“, 
веси, Ир 


. The inverse of a 2 x 2 matrix is as follows (de ned when ad Z bo): 


me 1 fda e 
c dl | ad—bc|-c a 


. If A and B are both invertible, then 


—1 


(A + B)7! = B7! (A7! + BTH)? A7! = А-1 (А-1 + В-1) BO. 


(2.6.18) 


. The row rank of a matrix A is de ned as the number of linearly independent 


rows of А. Likewise, the column rank equals the number of linearly indepen- 
dent columns of A. For any matrix, the row rank equals the column rank. 


. If A € R?*" has rank of n, then A is said to have full rank. 
. A square matrix is invertible if, and only if, it has full rank. 
. Rank(AB) < min [rank( A), rank(B)]. 

. Rank( A" A) = rank(AAT) = rank(A). 
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2.6.7 SYSTEMS OF LINEAR EGUATIONS 


1. 


Suppose that A is a matrix. Then Ax = b is a system of linear equations. If A 
is square and non-singular, there exists a unique solution x = A ^! b. 


For the linear system of equations involving n variables and m equations, writ- 
ten as Ах — b or 


ал121 + d1222 +5 ањ = bi, 


42124 + 02323 ++ Б ањ = ba, 
(2.6.19) 


ал171 + Gn2%2 + + арт = bn, 
the possible outcomes when searching for a solution are: 


(a) A unique solution exists, and the system is called consistent. 

(b) No such solution exists and the system is called inconsistent. 

(c) Multiple solutions exist, the system has an in nite number of solutions, 
and the system is called undetermined. 


The solvability cases of the linear systems Ax = b (when A is m x т) are: 


(a) If rank( A) = m = n, then there is a unique solution. 

(b) If rank( A) = m < n, then there is an exact solution with free parameters. 

(c) If rank(A) = n < m, then either there is a unique solution, or there is a 
unique least-squares solution. 

(d) If rank(A) < m < n, orrank(A) < n < m, огтапк(А) < п = m: 
then either there is an exact solution with free parameters, or there are 
non-unique least-squares solutions. 


If the system of equations Ах = b is undetermined, then we may nd the x 
that minimizes | Ах — ||, for some р. 


EXAMPLE ҥА=[1 1 1] andb—[b, b» bs] маи >b > bs 20 
then the minimum of || Ax — b||, in different norms is: 


p= 1 — Xoptimal — b» 
022 —> хә = (bi + b2 + b3)/3 (2.6.20) 
р= оо — Xoptimal = (bi + bs) /2 


. For the system of linear equations Ax = b (with A square and non-singular), 


the sensitivity of the solution x to pertubations in A and b is given in terms of 
the condition number of A de ned by 


cond(A) = || А-1) || All, (2.6.21) 


where ||-|| is any of the Lp norms. In all cases, cond(A) > 1. 
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When сопа(А) is egual to one, A is said to be perfectly conditioned. Matrices 
with small condition numbers are called well-conditioned. If cond( A) is large, 
then A is called ill-conditioned. 


6. For the system of equations (A + eF)x(e) = (b + ef), the solution satis es 


[х(є) — х(0)| ( ІРІ oD 2 

——5—. < cond(A) | e + « — | + O(e^). (2.6.22) 
х(0)| |All СІМ 

7. When A is singular, the de nitio n of condition number is modi ed slightly, in- 
corporating the pseudo-inverse of A, and is de ned by cond( A) = ||A *|| ||А|| 
(see page 151). 


8. The size of the determinant of a sguare matrix A is not related to the condition 
number of А. For example, ће n x n matrices below have к.(В,) = n2"71 
and det(B4) = 1; kp(Dn) = 1 and det(D,) = 107". 


Die ШИ А Dn = diag(107},..., 1075). 
9. Let A = (а;;) be ann x n matrix. Using the Lə condition number, cond A = 
maxj A (А)| / min; |А; СА) 


Matrix An хь = (aij) 


A is orthogonal 

aij = V2/(n + 1) sin(ijz / (n + 1)) 

Qij = бу +1 

aij = (i + j)/p, n = p — 1, pa prime 

The circulant whose rst row is (1,2,...,n) 


_ || ifi < j 


yo sli ij 
ifi-j 
ij = if | — j| = 1 
iť k — j| >2 
aij = 2min(i,j) — 1 cond (А) ~ 16n? /z? 
logcond (А) ~ Kn, 


aij = (i + j — 1)! (Hilbert matrix) Кез 


2.6.8 LINEAR SPACES AND LINEAR MAPPINGS 
1. Let R(A) and N(A) denote, respectively, the range space and null space of an 


m x n matrix A. They are de ned by: 
R(A) = {y | y = Ax; for some хе R^), 
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2. The projection matrix, onto a subspace S, denoted Ps, is the unique matrix 
possessing the three properties: 


(a) Ps = P3; 

(b) P2 = Pg (the projection matrix is idempotent); 

(c) The vector bs lies іп the subspace S if, and only if, bs = Psv for some 
vector v. In other words, b s can be written as a linear combination of the 
columns of Ps. 


3. When the m x n matrix A (with n < m) has rank n, the projection of A onto 
the subspaces of A is given by: 
PRA) = A(AT A)-1 AT, 
Prat) =T, (2.6.24) 
PN(AT) —[— A(AT AJ“! AT. 


When А is of rank m, the projection of A onto the subspaces of А is given by: 


Pra) = 1, 
Prat, = AT (AAT)71A, (2.6.25) 
Рул) —[— АТ(ААТУ"А. 


4, When А is not of full rank, the matrix АА satis es the requirements for a 
projection matrix. The matrix А is the coef cient matrix of the system of 
equations x; = Ab, generated by the least-squares problem min || — Ах) 
Thus, 

P R( A) — АА, 

Р R(AT) = АА, 
Puga) = 1— АА, 
Pyar) = I — АА. 


(2.6.26) 


5. A matrix B € R"*" is called similar to a matrix A € IR"*" if B = TI! AT 
for some non-singular matrix 7. 


6. If B is similar to A, then В has the same eigenvalues as A. 


7. If B is similar to A and if x is an eigenvector of A, then y = T'^!x is an 
eigenvector of В corresponding to the same eigenvalue. 


2.6.9 TRACES 


1. The trace of an n x n matrix A, usually denoted as tr( 4), is de ned as the 
sum of the n diagonal components of A. 
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2. The trace of ann x n matrix A equals the sum of the n eigenvalues of A, 1.е., 
tr A = ayy + doo +++ + ann = M + AQ +: Ал. 


3. The trace of a 1 x 1 matrix, a scalar, is itself. 
4. If A € R?** and B є R**™, then tr(AB) = (ВА). 


5. If A € R™**, В є Кх", and С € Кх", then tr(ABC) = tr(BCA) = 
tr(CAB). For example, if B = b is a column vector and C = cf is a row 
vector, then tr( 4be!) = tr(b! A) = (ст Ab). 


6. tr(A + yB) = tr(A) + ytr(B), where y is a scalar. 
7. tr(AB) = (Vec AT)! Vec B (see Section 2.6.17 for the “Vec” operation) 


2.6.10 GENERALIZED INVERSES 


1. Every matrix А (singular or non-singular, rectangular or square) has a general- 
ized inverse, or pseudo-inverse, A* de ned by the Moore—Penrose conditions: 


AA* A = A, 
Е 2.6.27 
(ААТ)Т = AAF, РЭВ 
(AtA)! = A+ A. 


There is а unigue pseudo-inverse satisfying the conditions in (2.6.27). 
2. If, and only if, A is square and non-singular, then A+ = A^. 
3. For a square singular matrix A, АА? Æ I, and AT A Z I. 


4. The pseudo-inverse is the unigue solution to min [АХ — In || p. 


5. The least-squares problem is to nd the x that minimizes ||y — Ах||„. The x of 
least norm is x — A*y. 


6. If A is a rectangular m x n matrix of rank n, with m > n, then A * is of order 
n x m and АТА = I € Вх". In this case A? is called a left inverse, and 
AAt ZI. 


7. If Ais a rectangular m x n matrix of rank m, with m < n, then А + is of order 
n x m and AAt = I € "х". In this case А? is called a right inverse, and 
A* A #1. 


8. The matrices AA* and A* A are idempotent. 
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9. 


10. 


ETE 13. 

EXAMPLE ї1А-11 1 1 1l then At = — 
1211 1 1 
11. 1 1 rae 


Computing the pseudo-inverse: The pseudo-inverse of A mxn can be deter- 
mined by the singular value decomposition A = UXV T. If A has rank r > 0, 
then Z,» xn has r positive singular values (c ;) along the main diagonal extend- 
ing from the upper left-hand corner and the remaining components of У are 
zero. Then At = (БУТ) = (VD)*tx*tu* = VX*U' since (УТ) = V 
and U+ = UT because of their orthogonality. The components oF in X* are 


st J10» ifo; #0: (2.6.28) 
2 0, if gj = 0. 


The pseudo-inverse is ill-conditioned with respect to rank-changing perturba- 
tions. For example: 


1|-1 i| 1110 
М "pis | c 0, 
6 A“ 
9“. .—2 0-2 Da NM : 
SA є = 9. 
101-1 -2|' 


(Note that the pseudo-inverse is the same as the inverse when є Z 0.) 


2.6.11 EIGENSTRUCTURE 


1. 


If A is a square n x n matrix, then the п degree polynomial de ned by 
det (A — AI) = 0 is called the characteristic polynomial, or characteristic 
equation of A. 


2. Then roots (not necessarily distinct) of the characteristic polynomial are called 


the eigenvalues (or characteristic roots) of A. Therefore, the values, A,, i = 
1,...,n, are eigenvalues if, and only if, | A — A;7| = 0. 


n 


3. The characteristic polynomial det (А — АГ) = У) r;A has the properties 


та = (—1)", 
—rn tr( A), 


Tn—1 


1 
Tn—3 = 75 ха tr(A) + Tn tr(A?)] P 


1 
Tn-3 = —3 [rn-2 tr(A) + т, tr(A’) +r, tr(A®)] , 


1 n 
--2 [V АР 
To " > Tp tr( A?) 
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4. Each eigenvalue A has a corresponding eigenvector x (different from 0) that 
solves the system Ax = Ax, or (A — АГ)х = 0. 


5. If x solves Ax = Ax, then so does ^x, where y is an arbitrary scalar. 


6. Cayley-Hamilton theorem: Any matrix A satises its own characteristic 
equation. That is Жы r, A = 0. 


7. The eigenvalues of a triangular (or diagonal) matrix are the diagonal compo- 
nents of the matrix. 


8. The eigenvalues of idempotent matrices are zeros and ones. 
9. If A is a real matrix with positive eigenvalues, then 
Зан (AAT) < Dua (AJ < [Aka AJ < Amax( AAT), (2.6.29) 
where Amin denotes the smallest and Алах the largest eigenvalue. 


10. If all the eigenvalues of a real symmetric matrix are distinct, then their associ- 
ated eigenvectors are also distinct (linearly independent). 


11. Real symmetric and Hermitian matrices have real eigenvalues. 


12. The determinant of a matrix is equal to the product of the eigenvalues. That is, 
if A has the eigenvalues 1, A2,... , An, then det (А) = M A+++ An. 


13. The following table shows the eigenvalues of speci с matrices 


matrix eigenvalues 


diagonal matrix diagonal elements 


upper or lower triangular diagonal elements 


А is n x n and nilpotent 0 (n times) 
А is n x n and idempotent of rank r | 1 (r times); and О (n — r times) 


(a — b)In + bJn, where Jn is the a+(n—1)b; anda —b(n — 1 
n x n matrix of all 1’s times) 


14. Let А have the eigenvalues {А}, А,..., An}. The eigenvalues of some func- 
tions of А are shown below: 


matrix eigenvalues 


AT eigenvalues of A 
АН complex conjugates of (AF, AŽ,... „Aby 
AF, k an integer DATAE AES 


A-*. k an integer, А non-singular TAE. Ag: At. 


q( А), g is a polynomial «(А9,40%,... GAR) 
S AS-1, S non-singular eigenvalues of A 


AB, where A ism x n, B is eigenvalues of В.А; and 0 (m — n times) 
n x m,and m >n 
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2.6.12 MATRIX DIAGONALIZATION 


1. 


If A € R”*” possesses n linearly independent eigenvectors Хі,..., Xn, then 
A can be diagonalized as ST! AS = A = diag(A1,..., An), where the eigen- 
vectors of А are chosen to comprise the columns of S. 


. If A € №" can be diagonalized into S 7! AS = A, then A* = SA*S-'!, or 


AF = STH AFS. 


. Spectral decomposition: Апу real symmetric matrix A € R"*" can be diago- 


nalized into the form А = U AUT, where A is the diagonal matrix of ordered 
eigenvalues of A such that A: > № >... > Ay, and the columns of U are the 
corresponding n orthonormal eigenvectors of А. 


That is, if A € R"“" is symmetric, then a real orthogonal matrix Q exists 
such that OT40) = dias(M,..., An). 


. The spectral radius of a real symmetric matrix A, commonly denoted by p( A), 


is de ned as p(A) = maxi <j<n |A;(A)]. 


. If A € R?** and BER"?! are diagonalizable, then they share a common 


eigenvector matrix S if and only if AB = BA. (Not every eigenvector of A 
need be an eigenvector for В, e.g., the above equation is always true if A = T.) 


. Schur decomposition: If A € C”*”, then a unitary matrix © € C””*” exists 


such that O" AQ = D + N, where D = diag(M,...,An) and N € C"*" is 
strictly upper triangular. The matrix @ can be chosen so that the eigenvalues 
А; appear in any order along the diagonal. 


. If A € R?*? possesses s < n linearly independent eigenvectors, it is similar 


to a matrix with s Jordan blocks (for some matrix М) 


Л 0 
J = M'AM = 2 | ; 


0 


where each Jordan block J; is an upper triangular matrix with (a) the single 
eigenvalue А; repeated n; times along the main diagonal; (b) (n; — 1) 1% 
appearing above the diagonal entries; and (c) all other components zero: 


„1 O 


pe e | (2.6.30) 


Js 
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2.6.13 MATRIX EXPONENTIALS 


1. Matrix exponentiation is de ned as (the series always converges): 


(At)? (41) 
2! 3! 


е^® 27+ Att (2.6.31) 


2. Common properties of matrix exponentials are: 

(a) (e45) (e^t) = eA G0, 

(b) (e^t) (et) = І, 

(с) Ze^t = Ae“, 

(а) When А and В are sguare matrices, the commutator of А and В 15 С = 
[B, A] = BA — AB. Then e(4+B) = e^ePeC/? provided that [C, A] = 

‚В| = 0 (1.е., each of А an commute with their commutator). In 

C,B 0G h of A and B ith thei ) I 


particular, if A and В commute then e4+? = e4e?. 


3. For a matrix А € R"“", the determinant of e^' is given Бу: 


det (64%) еее = цг (2.6.32) 


4. The diagonalization of e^t, when A is diagonalizable, is given by e^t = 
SeP' $-! where the columns of S consist of the eigenvectors of А, and the 
entries of the diagonal matrix D are the corresponding eigenvalues of A, that 
is, A= SDS-!. 


2.6.14 QUADRATIC FORMS 
1. Fora symmetric matrix A, the map x — x? Ax is called a pure quadratic form. 
It has the form 


n n 

TA A NE 2 2 

X Ax = 04) Piť j = 01121 + 0122172 + а217921 + +++ + Ann. 
121 j=l 


(2.6.33) 


2. For A symmetric, the gradient of x" 4x/x!x equals zero if, and only if, x is 
an eigenvector of 4. Thus, the stationary values of this function (where the 
gradient vanishes) are the eigenvalues of A. 


3. The ratio of two quadratic forms (В non-singular) u(x) = (x"Ax)/(x" Bx) 
attains stationary values at the eigenvalues of B ^! A. In particular, 


max — Naas А), апа min = Лав ŤA): 


4. A matrix A is positive de n ite if x! Ax > 0 for all x £ 0. 
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5. A matrix A is positive semi-de n ite if x! Ax > 0 for all x. 


6. For a real, symmetric matrix А € R"“", the following are necessary and 
suf cien t conditions to establish the positive de niteness of A: 


(a) All eigenvalues of A have A, > 0, fori = 1,...,n, and 
(b) The upper-left sub-matrices of A, called the principal sub-matrices, de- 
ned by A; = [а11], 


011 13" Gin 
a a DE E a 
pm 011 012 A = 21 22 2n 
2/5 , 499 n — а Ӯ . , 
Q21 Q22 
Ani  Qn2 ''' Ann 


have det( Аһ) > 0, for all k = 1,...,n. 


7. If А is positive de nite, then all of the principal sub-matrices of A are also 
positive de nite. Additionally, all diagonal entries of A are positive. 


8. For a real, symmetric matrix A € R"“?, the following are necessary and 
suf cien t conditions to establish the positive semi-de niten ess of А: 


(a) All eigenvalues of A have A, > 0, fori = 1,...,n, 
(b) The principal sub-matrices of A have det А, > 0, for all k =1,...,n. 


9. If A is positive semi-de nite, then all of the principal sub-matrices of A are 
also positive semi-de nite. Additionally, all diagonal entries of А are non- 
negative. 


10. If the matrix Q is positive de nite, then (x! — x})Q7'(x — xo) = 1 is the 
equation of an ellipsoid with its center at xj. The lengths of the semiaxes аге 
equal to the square roots of the eigenvalues of ©; see page 330. 


2.6.15 MATRIX FACTORIZATIONS 


1. Singular value decomposition (SVD): Any m x n matrix A can be written as 
the product A = СУУТ, where U is an m x m orthogonal matrix, V is an 
n x n orthogonal matrix, and X = diag(G1,G3,...,G»), with p = min (т, п) 
ando; > 09 >>. > ор > 0. The values oj, ї = 1,...,p, are called the 
singular values of A. 


(a) When rank(A) = r > 0, A has exactly r positive singular values, and 
Opp] ээл 0р = 0. 


(b) When A is a symmetric n x n matrix, then o; = |А: |, ..., On = |А, 
where Ау, À»,..., An are the eigenvalues of A. 
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(c) When А 15 ап m x n matrix, if m > n then the singular values of А 
are the sguare roots of the eigenvalues of AT A. Otherwise, they are the 
square roots of the eigenvalues of ААТ. 


2. Any non-singular m x n matrix A of maximal rank can be factored as PA = 
LU, where Р is a permutation matrix, Г, is lower triangular, and U is upper 
triangular. 


3. QR factorization: If all the columns of A € IR"'*" are linearly independent, 
then A can be factored as А = QR, where O € R"“" has orthonormal 
columns and RE R"“" is upper triangular and non-singular. 


4. If A € R"*" is symmetric positive de nite, then 
T 
A= LDI" = LD? D'I" = Ua (2р) = GG! (2.6.34) 


where L is a lower triangular matrix and D is a diagonal matrix. The factor- 
ization А = GGT is called the Cholesky factorization, and the matrix G is 
commonly referred to as the Cholesky triangle. 


2.6.16 THEOREMS 


1. Frobenius—Perron theorem: If A > 0 (i.e., A is positive de nite), then there 
exists a Ag > 0 and хо > 0 such that 


(а) Axo = AoXo, 

(b) if A is any other eigenvalue of A, A Z Ag, then |A| < А, and 

(c) Ао is an eigenvalue with geometric and algebraic multiplicity egual to 
one. 


2. If A > 0, and A* > 0 for some positive integer k, then the results of the 
Frobenius-Perron theorem apply to A. 


3. Courant-Fischer minimax theorem: If A; ( A) denotes the 1"! largest eigenvalue 
of a matrix A = AT € R”*”, then 


T 
АХА)- max min 2 


Же 2.6.35 
S; 0/хс6; хіх 2 $ n ( ) 


where x € К” and S, is a j-dimensional subspace. 


From this follows Raleigh's principle: The quotient R(x) = х! Ax/x!x is 
minimized by the eigenvector x = Хү corresponding to the smallest eigenvalue 
M of A. The minimum of R(x) is А1, that is, 


. . Xl Ax xfAx, xX 
min R(x) = min Tx — R(x) = Es = Ex = M. (2.6.36) 
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4. Cramer’s rule: The j component of x = A~'b is given by 


det, B, 
Ces ; where 
7 det A 
@11 012 e 01,j—1 bi Q1,j41 ГИА Gin (2.6.37) 
В, = ЖЕ 
dni 492... Qm,j—1 bn Qn,j+l ++.» Ann 
The vector b = [b1 wel bn] » replaces the j^^ column of the matrix A to 


form the matrix B;. 


5. Sylvester's law of inertia: For a symmetric matrix А € R"“", the matrices А 
and CT AC, for С non-singular, have the same number of positive, negative, 
and zero eigenvalues. 


6. Gerschgorin circle theorem: Each eigenvalue of an arbitrary n x n matrix 
A = (aij) lies in at least one of the circles (C1, C2, . . . , Cn } in the complex 
n 


plane, where circle С; has center ас, and radius р; given by р; = 5 [aj |. 
7-1 


jzi 


2.6.17 THE VECTOR OPERATION 


The matrix Am xn can be represented as a collection of m x 1 column vectors: А = 


(аі а ... an]. De ne Vec A as the matrix of size nm x 1 (i.e., a vector) by 
bal 
ах 
ҮесА-1 1. (2.6.38) 
an 


This operator has the following properties: 
1. tr AB = (Vec AT)" Vec B. 


2. The permutation matrix U that associates Vec X and Vec X T (that is, Vec XT = 
U Vec X) is given by: 


U = [Vec E], УесЕД ... УесЕД|-У Б,ФЕ (2.639) 
r,s 


3. Vec(AY В) = (ВТ 8 A) VecY. 
4. If A and В are both of size n X n, then 


(a) Vec AB = (1, © A) Vec B. 
(b) Vec AB = (ВТ & A) Vec In. 
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2.6.18 KRONECKER PRODUCTS 


If the matrix A = (а;;) has size m x n, and the matrix В = (0,5) has size r x s, 
then the Kronecker product (sometimes called the tensor product) of these matrices, 
denoted A 69 B, is de ned as the partitioned matrix 


а1 В ато В Pau аһ В 

a»1B а» B эз a2n B 
АВ = . : . 

QmiD amB ... аһВ 


Hence, the matrix A 8 B has size mr x ns. 


EXAMPLE 14 – ps | adip Ё | E 


21 422 boi бээ 

алібі  ai1bi> 012011 012612 

ал В ai2B| [атф aiibe2 012021) 012022 

axın B а»В a21bı1 à21012. (022011 (022612 
21021  à21023 022021 a22b22 


лев | 


The Kronecker product has the following properties: 


1. 


10. 


If z and w are vectors of appropriate dimensions, then 
Az 9 Bw = (А 9 В)(2 ® v). 


. If a is a scalar, then (aA) 9 B = A 9 (aB) -а(А 8 В). 


. The Kronecker product is distributive with respect to addition: 


(а) (А+В)®С=А®С+В®С,апа 
(b) А®(В+С)=А®В+АФ®С. 


. The Kronecker product is associative: A 9 (В ® С) = (A & B) 
. (AQ В) = АТ ® BT. 


. If the inverses exist, then (A & B)! = A7! @ B^1. 


(2.6.40) 


(2.6.41) 


9 С. 


. Тһе mixed product rule: If the dimensions of the matrices are such that the 
following expressions exist, then (A 8 B)(C © Р) = AC © BD. 


. If {A;} and (xj) are the eigenvalues and the corresponding eigenvectors for 


A, and fu] and (y; are the eigenvalues and the corresponding eigenvectors 
for B, then A 8 В has eigenvalues TA, u, + with corresponding eigenvectors 


ixi Фу, 


(det А)" (det В)". 


If f is an analytic matrix function and A has size n X n, then 
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‚ If matrix A has size n x n and B has size m x m, then det(A © В) = 


(а) fUn & А) = In 8 f(A), and 
(b) f(A 8 In) = f(A) © In. 
11. tr(A © B) = (tr A)(tr B). 


12. If A, B, C, and D are matrices with A similar to C and B similar to D, then 
A ® B is similar to C & D. 


13. I C(t) = A(t) & B(t), then 1 = 44 & Bc Ac 48. 


2.6.19 KRONECKER SUMS 


If the matrix A = (a;j) has size n x n and matrix B = (Ь;;) has size m x m, then 
the Kronecker sum of these matrices, denoted A © B, is de ned ? as 


АӨВ-А91,--1, © B. (2.6.42) 
The Kronecker sum has the following properties: 


1. If A has eigenvalues (A;) and B has eigenvalues (11, +, then A © B has eigen- 
values TA, + uj]. 


2. The matrix equation AX + X В = С may be equivalently written as 
(BT © A) Vec X = Vec C, where Vec is de ned in Section 2.6.17. 


3. ASB = еА Q еВ, 


2.7 ABSTRACT ALGEBRA 


2.7.1 DEFINITIONS 


1. A binary operation on a set S is a function x: 5 x S > 5. 


2. An algebraic structure (S,*1,...,*n) consists of a non-empty set S with one 
or more binary operations х, de ned on S. If the operations are understood, 
then the binary operations need not be mentioned explicitly. 


3. The order of an algebraic structure S is the number of elements in S, written 


[5]. 


?Note that A Ф B is also used to denote the (m + n) x (m + n) matrix lo zl І 


© 2003 Ьу СКС Press LLC 


4. A binary operation x on an algebraic structure (S, +) may have the following 
properties: 


(a) Associative: a x (bx c) = (ax b) x c for all a,b,c € S. 

(b) Identity: there exists an element e € S (identity element of S) such that 
exa=axe=aforalla€ S. 

(c) Inverse: a! € S is an inverse of aif ажат! = аі xa = e. 

(d) Commutative (or abelian): if a xb = b xa for all a,b € S. 


1 1 


5. A semigroup (S,x) consists of a non-empty set S and an associative binary 
operation x on S. 


6. A monoid (S, ж) consists of a non-empty set S with an identity element and 
an associative binary operation x. 


2.7.1.1 Examples of semigroups and monoids 
1. The sets М = {0,1,2,3,...} (natural numbers), Z = (0, +1, +2,...} (in- 
tegers), Q (rational numbers), R (real numbers), and C (complex numbers) 
where x is either addition or multiplication are semigroups and monoids. 


2. The set of positive integers under addition is a semigroup but not a monoid. 


3. If A is any non-empty set, then the set of all functions f : А — A where x is 
the composition of functions is a semigroup and a monoid. 


4. Given a set S, the set of all strings of elements of S, where x is concatenation 
of strings, is a monoid (the identity is А, the empty string). 


2.7.2 GROUPS 


1. A group (С, ж) consists of a set С with a binary operation х de ned on С such 
that x satis es the associative, identity, and inverse laws. Note: The operation 
k is often written as + (an additive group) or ав. or x (a multiplicative group). 


(a) If + is used, the identity is written 0 and the inverse of a is written —a. 
Usually, in this case, the group is commutative. The following notation 
is then used: na =a +... + a. 
—— 
n times 


(b) If multiplicative notation is used, a x b is often written ab, the identity is 


often written 1, and the inverse of a is written аг. 


2. The order of a € G is the smallest positive integer n such that a^ — 1 where 
a" —a-a---a(ntimes) (ora-F a +---+a = Oif С is written additively). 
If there is no such integer, the element has in nite order. In a nite group of 
order n, each element has some order k (depending on the particular element) 
and it must be that k divides n. 


3. (Н, х) is a subgroup of (С, ж) if H C С and (Н, ж) is a group (using the same 
binary operation as in (С,ж)). 
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. The cyclic subgroup (a) generated by a € G is the subgroup (a? | n € Z} = 


1...,a7? = (a')?, a“, a9 = e, a, à?,...). The element a is a generator of 
(a). A group G is cyclic if there is a € G such that G = (a). 


. If H is a subgroup of a group G, then a left [right] coset of H in G is the set 


aH = {ah | h € H} [Ha = (ha| h € HY]. 


. A normal subgroup of a group С is a subgroup H such that aH = Ha for all 


a € G. 


. А simple group is a group С Z {e} with only С and [e] as normal subgroups. 


. If H is a normal subgroup of G, then the quotient group (or factor group) of 


G modulo Н is the group G/H = {aH | a € G}, with binary operation 
aH -bH = (ab)H. 


. A nite group С is solvable if there is a sequence of subgroups G 1,G»,..., 


Gp, with Gi = G and Gg = {e}, such that each Ср is a normal subgroup 
of G; and G;/Gj41 is abelian. 


2.7.2.4 Facts about groups 


1. 
2. 
3. 


The identity element 1s unigue. 
Each element has exactly one inverse. 


Each of the equations a xx = b and z ха = b has exactly one solution, 
x2a xbandz —bxa“!. 


„da =a. 
. (axb)! = b xa. 


. The left (respectively right) cancellation law holds in all groups: If axb = axc 


then b = c (respectively, if bx a = c x a then b = c). 


. Lagrange’s theorem: If G is a nite group and H is a subgroup of G, then the 


order of H divides the order of G. 


. Every group of prime order is abelian and hence simple. 
. Every cyclic group is abelian. 
. Every abelian group is solvable. 


. Feit-Thompson theorem: АП groups of odd order are solvable. Hence, all 


nite non-Abelian simple groups have even order. 


. Finite simple groups are of the following types: 


(а) Zp (p prime) 

(b) A group of Lie type 

(c) An (n > 5) 

(d) Sporadic groups (see table on page 191) 


© 2003 by СКС Press LLC 


2.7.2.2 Examples of groups 


1. 
2. 
3. 


10. 


Z, Q, R, and C, with x the addition of numbers, are additive groups. 
For n a positive integer, nZ = {nz | z € Z} is an additive group. 


Q — {0} = Q*, R — {0} = R*, C — {0} = C*, with x the multiplication of 
numbers, are multiplicative groups. 


. Zn = Z/nZ = {0,1,2,...,n — 1} is a group where x is addition modulo n. 


„Z = {k | k € Zn, k has a multiplicative inverse (under multiplication mod- 


ulo n) in Z4) is a group under multiplication modulo n. If p is prime, 2, 18 
cyclic. If p is prime and a € 2, has order (index) p — 1, then a is a primitive 
root modulo p. See the tables on pages 192 and 193 for power residues and 
primitive roots. 


. If (Gi, 1), (Go, *2),---,(Gn,*n) are groups, the (direct) product group is 


(Сі х Go X X Gn,x) = {(a1,@2,...,@n) | a: € Gi, = 1,2,... n} 
where x is de ne d by 


(a1, @2,...,Qn) ж (b1,02,. . ., ba) = (a1 X1 by, a2 жо bo,... „Gn Жа bn). 


. All m x n matrices with real entries form a group under addition of matrices. 


. All n x n matrices with real entries and non-zero determinants form a group 


under matrix multiplication. 


. АП 1-1, onto functions f : S > S (permutations of S), where S is any non- 


empty set, form a group under composition of functions. See Section 2.7.9. 


In particular, if S = {1,2,3,...,n}, the group of permutations of S is called 
the symmetric group, Sn. In Sn, each permutation can be written as a prod- 
uct of cycles. A cycle is a permutation о = (i4 i2 +++ ip), where ово(41) = 
12,0(12) = із,...,6(%,) = 41. Each cycle of length greater than 1 can be 
written as a product of transpositions (cycles of length 2). A permutation is 
even (odd) if it can be written as the product of an even (odd) number of 
transpositions. (Every permutation is either even or odd.) The set of all even 
permutations in 5, is a normal subgroup, Ад, of Sn. The group А, is called 
the alternating group on n elements. 


Given a regular polygon, the dihedral group D „ is the group of all symme- 
tries of the polygon, that is, the group composed of the set of all rotations 
around the center of the polygon through angles of 360k/n degrees (where 
k = 0,1,2,...,n — 1), together with all re ections in lines passing through 
a vertex and the center of the polygongon, using composition of functions. 
Alternately, Dn = {а | i 20,1; j —0,1,...,n — 1; ава! = b“). 
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2.7.3 RINGS 
2.7.3.1 De nitions 


1. 


10. 


12. 


. A unit in a ring with unity is an element a with a multiplicative inverse а” 


A ring (В, +, :) consists of a non-empty set R and two binary operations, + 
and -, such that (R, +) is an abelian group, the operation · is associative, and 
the left distributive law a(b + c) = (ab) + (ac) and the right distributive law 
(a + b)e = (ac) + (bc) hold for all a, b, c € В. 


. A subset S of a ring R is a subring of R if S is a ring using the same operations 


used in R with the same unit. 


. A ring R is a commutative ring if the multiplication operation is commutative: 


ab = ba for all a,b € R. 


. A ring R (with R Z {0}) is a ring with unity if there is an element 1 (called 


unity) such that al = 1a — a foralla € R. 
1 


(that is, аа"! = a~ta = 1). 


. Ifa zz 0, b #0, and ab = 0, then a is a left divisor of zero and b is a right 


divisor of zero. 


. A subset Г of a ring (R, +, +) is a (two-sided) ideal of R if (T, +) is a subgroup 


of (R, +) and / is closed under left and right multiplication by elements of R 
Gf z € I andr € R, then rz € J and zr € I). 


. Anideal ГС Ris 


(a) Proper: if I Z {0} and I AR 

(b) Maximal: if I is proper and if there is no proper ideal properly contain- 
ing I 

(c) Prime: if ab € I implies that a or b € T 

(d) Principal: if there isa € R such that / is the intersection of all ideals 
containing a. 


. If I is an ideal in a ring R, then a coset is a set r + I = {r +a |a € I}. 


If Г is an ideal in a ring R, then the quotient ring is the ring R/T = {r + I | 
r € R}, where (r +I)+(s +I) = (r+s)+I апа ("+ D)(s4- T) = (rs) +I. 


. An integral domain (R,+,-) is a commutative ring with unity such that can- 


cellations hold: if ab = ac then b = c (respectively, if ba = ca then b = с) 
for all a, b, c € R, where a Z 0. (Equivalently, an integral domain is a 
commutative ring with unity that has no divisors of zero.) 


If R is an integral domain, then a non-zero element r € R that is not a unit is 
irreducible if r = ab implies that either a or b is a unit. 
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13. 


14. 


15. 


16. 


If R is an integral domain, a non-zero element r € R that is not a unit is 
a prime if, whenever r|ab, then either r|a or r|b (a|y means that there is an 
element z € R such that y = zz.). 


A unigue factorization domain (UFD) is an integral domain such that every 
non-zero element that is not a unit can be written uniguely as the product of 
irreducible elements (except for factors that are units and except for the order 
in which the factor appears). 


A principal ideal domain (PID) is an integral domain in which every ideal is a 
principal ideal. 


A division ring 1s a ring in which every non-zero element has a multiplicative 
inverse (that is, every non-zero element is a unit). (Equivalently, a division 
ring 1s a ring in which the non-zero elements form a multiplicative group.) A 
non-commutative division ring is called a skew eld. 


2.7.3.2 Facts about rings 


1. 


The set of all units of a ring is a group under the multiplication de ned on the 
ring. 


. Every principal ideal domain is a unique factorization domain. 


. If R is a commutative ring with unity, then every maximal ideal is a prime 


ideal. 


. If Ris a commutative ring with unity, then R is a eld if and only if the only 


ideals of R are R and {0}. 


. If R is a commutative ring with unity and J ZZ R is an ideal, then R/T is an 


integral domain if and only if / is a prime ideal. 


. If Ris a commutative ring with unity, then [ is a maximal ideal if and only if 


R/Tisa eld. 


. If f(x) € F[r] (where F isa eld) and the ideal generated by f(z) is not {0}, 


then the ideal is maximal if and only if f(a) is irreducible over Р. 


. There are exactly four normed division rings; they have dimensions 1, 2, 4, 


and 8. They are the real numbers, the complex numbers, the quaternions, and 
the octonions. The quaternions are non-commutative and the octonions are 
non-associative. 


2.7.3.3 Examples of rings 


1. 


Z (integers), Q (rational numbers), IR (real numbers), and C (complex num- 
bers) are rings, with ordinary addition and multiplication of numbers. 
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2. Zn is a ring, with addition and multiplication modulo n. 


3. If yn is not an integer, then Z[/n] = {a+ bn | a,b € Z}, where (a + 
byn) + (c + dyn) = (a + c) + (b + d) n and (a + b/n)(c + dyn) = 
(ac + nbd) + (ad + bc),/n is a ring. 


4. The set of Gaussian integers Z[i] = {a+ bi | a,b € Z} is a ring, with the 
usual de nitio ns of addition and multiplication of complex numbers. 


5. The polynomial ring in one variable over a ring R is the ring R[x] = {a nz” + 
+++ base + ao | a; Є R; = 0,1,...,n; n € N}. (Elements of R[z] are 
added and multiplied using the usual rules for addition and multiplication of 
polynomials.) The degree of a polynomial ang” +- · · +417 + ао with an 4 0 
is n. A polynomial is monic if ад = 1. A polynomial f (x) is irreducible over 
R if f(x) cannot be factored as a product of polynomials in R[x] of degree 
less than the degree of f(a). A monic irreducible polynomial f(x) of degree 
k in Z, [v] (p prime) is primitive if the order of x in Z,[r]/ (f (z)) is p^ — 1, 
where (f(x)) = {f(x)g(a) | g(x) € 25121) (the ideal generated by f(z)). 


For example, the polynomial x? + 1 is 


(a) Irreducible in R[x] because x” + 1 has no real root 
(b) Reducible in C[a] because z? + 1 = (x — i)(a + i) 
(c) Reducible in Z2[x] because x? + 1 = (a + 1)? 

(d) Reducible in 75 [2] because x? + 1 = (x + 2)(a + 3) 


See the table on page 194. 


6. The division ring of quaternions is the ring ({a + bi + cj + dk | a,b,c,d € 
R}, +,-), where operations are carried out using the rules for polynomial ad- 
dition and multiplication and the de ning relations for the quaternion group Q 
(see page 182). 


7. Every octonion is a real linear combination of the unit octonions (1, e 1, e», еҙ, 
ел, €5, ев, ет}. Their properties include: (a) е? = —1, (b) ese; = —ejej when 
i Æ j; (с) the index doubling identity: eje; = ej => еоео; = ео; and 
(d) the index cycling identity: eje; =e, => етері = екі Where the 
indices are computed modulo 7. The full multiplication table is as follows: 
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8. The following table gives examples of rings with additional properties: 


ring commuta- | integral | principal Euclidean division 
with unit domain 
yes yes yes 


PEN 


2 (p prime) 

Zn (n composite) 
ДЕ 

м nxn 


2.74 FIELDS 
2.7.4.1 De nitions 


1. A eld (F,+,-) is a commutative ring with unity such that each non-zero ele- 
ment of F has a multiplicative inverse (equivalently, a eld is a commutative 
division ring). 


2. The characteristic of a eld (or a ring) is the smallest positive integer n such 
that 1 + 1+ ---+ 1 = 0 (n summands). If no such n exists, the eld has 
characteristic 0 (or characteristic оо). 


3. Field K is an extension eld of the eld Fif F is a sub eld of K (i.e, F K, 
and F is a eld using the same operations used in K). 


2.7.4.2 Examples of elds 
1. Q, R, and C with ordinary addition and multiplication are elds. 


2. Zp (pa prime) is a eld under addition and multiplication modulo р. 


3. F[a]/(f(x)) is a eld, provided that F is a eld and f(x) is a non-constant 
polynomial irreducible in [2]. 


2.7.5 QUADRATIC FIELDS 
2.7.5.1 De nitions 


1. A complex number is an algebraic integer if it is a root of a polynomial with 
integer coef c ients that has a leading coef cient of 1. 


2. If d is a square-free integer, then Q( vd) = {a + bvd}, where a and b are 
rational numbers, is called a quadratic eld. If d > 0 then Q( Vd) is a real 
quadratic eld ; if d < 0 then Q( vd) is an imaginary quadratic. eld . 
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3. The integers of an algebraic number eld are the algebraic integers that belong 
to this number eld. 


4. If (a; B, y) are integers in Q( vd) such that ay = £ then we say that a divides 
B; written al. 


5. An integer e in Q(Vd) is a unit if it divides 1. 
6. Ifa = а + БУ then 


(a) the conjugate of a is à = a — b Vd. 
(b) the norm of a is N(a) = aa = a? — db’. 


7. If a is an integer of Q(Vd) and if e is a unit of Q( Vd), then the number «а 
is an associate of a. A prime іп Q(v/d) is an integer of Q(V/d) that is only 
divisible by the units and its associates. 


8. A quadratic eld Q(V/d) is a Euclidean eld if, given integers a and 8 in 
OV) with B Z 0, there are integers y and б in Q( Vd) such that a = y8 +6 
and |N(2)| < |N(8)]. 


9. A quadratic eld Q(vd) has the unique factorization property if, whenever a 
is a non-zero, non-unit, integer in Q( Vd) with a = em Ta «m, = eaim) 
where e and € are units, then r = s and the primes т; and Tj can be paired off 
into pairs of associates. 


П 
8 


2.7.5.2 Facts about guadratic elds 
1. The integers of Q( V/d) are of the form 


(a) a + bV/d, with a and b integers, if d = 2 (mod 4) ord = 3 (mod 4). 
(b) a +b (4 ) with a and b integers, if d = 1 (mod 4). 


2. Norms are positive in imaginary quadratic elds, but not necessarily positive 
in real quadratic elds. It is always true that N (a8) = М(о) (8). 


3. If a is an integer in Q(Vd) and N (o) is an integer that is prime, then a is 
prime. 


4. The number of units іп Q( Vd) is as follows: 
(a) If d = —3, there are 6 units: +1, +23, and +255, 
(b) If d — —1, there are 4 units: +1 and +1. 
(c) If d < 0 and d Z —1 and d Z —3 there are 2 units: +1. 


(d) If d > 0 there are in nitely many units. There is a fundamental unit, € 9, 
such that all other units have the form +e(j where n is an integer. 
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5. The guadratic eld Q(V ad) is Euclidean if and only if d is one of the following: 
11, —7, —3, —2, —1, 2, 3, 5, 6, 7, 11, 13, 17, 19, 21, 29, 33, 37, 41, 57, 73. 


6. If d < 0 then the imaginary quadratic eld Q (va) has the unique factoriza- 


tion property if and only if d is one of the following: —1, —2, —3, —7, —11, 
—19, —43, —163. 


7. Of the 60 real quadratic elds Q( V/d) with 2 < d < 100, exactly 38 of them 
have the unique factorization property: d — 2, 3, 5, 6, 7, 11, 13, 14, 17, 19, 
21, 22, 23, 29, 31, 33, 37, 38, 41, 43, 46, 47, 53, 57, 59, 61, 62, 67, 69, 71, 73, 
TI, 83, 86, 89, 93, 94, and 97. 


2.7.5.3 Examples of quadratic elds 


1. The algebraic integers of Q(4/ —1) are of the form a + bi where a and b are 
integers; they are called the Gaussian integers. 


2. The number 1+ V2 is a fundamental unit of Q( /2). Hence, all units in Q( 2) 
have the form +(1 + V2)” forn = 0, +1, +2,.... 


3. The eld ©) (V —5) is not a unique factorization domain. This is illustrated by 
0-2-3-1(1-4-5)-(1-4-5), yet each of {2,3,1 + /—5, 1 — /—5] 


is prime in this eld. 


4. The eld Q (v 10) is not a unique factorization domain. This is illustrated by 
6 = 2.3 = (4 + v10) - (4 — v 10), yet each of {2,3,4 + v 10,4 — v 10} is 


prime in this eld. 


2.7.6 FINITE FIELDS 
2.7.6.1 Facts about nite elds 


1. If pis prime, then the ring Zp isa nite eld. 


2. If p is prime and n is a positive integer, then there is exactly one eld (up to 
isomorphism) with p" elements. This eld is denoted GF(p") or Fy» and is 
called a Galois eld . (See the table on page 190.) 


3. For F a nite eld, there is a prime p and a positive integer n such that F has 
p" elements. The prime number р is the characteristic of F. The eld Fis а 
nite extension of Zp, that is, F isa nite dimensional vector space over 2. 


4. If F isa nite eld, then the set of non-zero elements of F under multiplication 
is a cyclic group. А generator of this group is a primitive element. 


5. There are ó(p" — 1) /n primitive polynomials of degree n (n > 1) over GF(p), 
where ф is the Euler ó-function. (See table on page 128.) 
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Lje uk /)р” 


where u is the Mobius function. 


6. There are irreducible polynomials of degree k over GF (p”), 


7. If F is a nite eld where |F| = k and p(x) is a polynomial of degree n 
irreducible over F, then the eld | Е|21/(р(4:)) has order k". If a is a root of 
p(x) € F[z] of degree n > 1, then F[z]/(p(z)) = {сһ—1а” eio 
со | cj € F for all i1. 

8. When р is a prime, GF(p") can be viewed as a vector space of dimension 
n over Ер. A basis of Ру» of the form (a, a?, aP’, whey ar is called a 
normal basis. If a is a primitive element of Fp» ‚ then the basis is said to be a 


primitive normal basis. Such an a satis es a primitive normal polynomial of 
degree n over Fy. 


Degree Primitive normal polynomials 
n р-2 


Er 14142 
z? +z? +1 r? cpu +2 


e+e? +1 x^ + 17 +4r+2 
2 +1 +1+1+1 12»+2x“+1 а? + 2x) + 3 
| хе фа? +r? +2 х6 ъа? +2 
х +e +1 2041941741 1 +26 +2 


2.7.7 HOMOMORPHISMS AND ISOMORPHISMS 


2.7.7.1 De nitions 
1. A group homomorphism from group (71 to group G is a function р: Gi > 
С» such that y(ab) = y(a)y(b) for all a,b € С). Note: ag is often written 
instead of (а). 


2. A character of a group С is a group homomorphism х: С — C* (non-zero 
complex numbers under multiplication). (See table on page 191.) 


3. A ring homomorphism from ring Ві to ring Бә is a function o : Ry > Ra 
such that o(a + b) = y(a) + (6) and y(ab) = y(a)y(b) for all a, b € Ry. 


4. An isomorphism from group (ring) S1 to group (ring) 5» is a group (ring) 
homomorphism y : Sı — Sə that is 1-1 and onto 55. If an isomorphism 
exists, then S1 is said to be isomorphic to $5. Write 51 25 55. (See the table 
on page 176 for numbers of non-isomorphic groups and the table on page 178 
for examples of groups of orders less than 16.) 


5. An automorphism of S is ап isomorphism р: S > 5. 


6. The kernel of a group homomorphism o : G4 — Ga is p“!(e) = {g € 
Gi | (g) = e). The kernel of a ring homomorphism о: Ry — Ra is 
9750) = {r € Ri | (r) = 0}. 
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2.7.7.2 Facts about homomorphisms and isomorphisms 


1. 
2. 


10. 


11. 


If ©: G1 > Ga is a group homomorphism, then (С 1) is a subgroup of Go. 


Fundamental homomorphism theorem for groups: If © : Gi > Ga isa 
group homomorphism with kernel K, then K is a normal subgroup of G 1 and 
Gi/ K = (Gi). 


. If Gis acyclic group of in nite order, then С 2 (Z, +). 
‚ If Gis acyclic group of order n, then С © (Zn, +). 


. If pis prime, then there is only one group (up to isomorphism) of order р, the 


group (Zp,+). 


‚ Cayley’s theorem: If G is a nite group of order n, then G is isomorphic to 


some subgroup of the group of permutations on n objects. 


. Zm X Zn = Zmn if and only if m and n are relatively prime. 


‚п = ni na +... ny where each nj is a power of a different prime, then 


Zn = Zn, X Zn, X +++ X Түц 


. Fundamental theorem of nite abelian groups: Every nite abelian group G 


(order > 2) is isomorphic to a product of cyclic groups where each cyclic 
group has order a power of a prime. That is, there is a unique set {n1,...,n4} 
where each n; is a power of some prime such that С 2 Zn, X Zna х: х2. 


Fundamental theorem of nitely generated abelian groups: If G is a nitely 

generated abelian group, then there is a unique integer n > 0 and a unique set 
{n,...,nx} where each n; is a power of some prime such that G — Zp, x 
Zing XX Zn, X Z” (Gis nitely generated if there are a1,G2,... „Gn ЕС 
such that every element of G can be written as ар aj) ++“ ар where k, Є 
{1,...,n} (the k, are not necessarily distinct) and e; € (1, —11). 


Fundamental homomorphism theorem for rings: If p : Ry > Rə is a ring 
homomorphism with kernel K, then K is an ideal in Ry and R4 /К = (R1). 


2.7.8 MATRIX CLASSES THAT ARE GROUPS 


In the following examples, the group operation is ordinary matrix multiplication: 


1. 
. GLn,R) all real non-singular n x n matrices 
‚ O(n) all n х n matrices A with AA! = Г, also called the 


GL(n,C) all complex non-singular n x n matrices 


orthogonal group 


. SL(n,C) all complex n x n matrices of determinant 1, also called 


the unimodular group or the special linear group 


. SL(n,R)  allreal n x n matrices of determinant 1 
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6. SO(2) rotations of the plane: matrices of the form 


со80 -віп0 
ыа Р сов0 | 
7. SO(n) rotations of n-dimensional space 
8. SU(n) all n х n unitary matrices of determinant 1 
9. U(n) ай n x n unitary matrices with UU# = 1 


Symmetric group ! All permutations on (1, 2,...,n} 
Alternating group ! All even permutations on 41, 2,...,n} 


Cyclic group Generated by (12... n) 

Dihedral group Generated by (12... n) and 
(1n)(2n—1)(3 n—2) --- 

Identity group (1)(2) --- (n) is the only permutation 


EXAMPLE With p = 3 elements, the identity permutation is (123), and: 
Аз = {(123), (231), (312)}, 


Cs = {(123), (231), (312)}, 

Ds = {(231), (213), (132), (321), (312), (123)} 
Ез = {(123)} and 

S3 = {(231), (213), (132), (321), (312), (123)} 


2.7.9.1 Creating new permutation groups 

Let A have permutations {X;}, order n, degree d, let В have permutations {Y;}, 
order m, degree e, and let С (a function of A and В) have permutations {W |, +, order 
р, degree f. 


Sum C=A+B(|W=XUY 
Product 


Composition | C = = ALB] 
Power 


2.7.9.2 Polya theory 


Let r be a permutation. De ne Inv (т) to be the number of invariant elements (i.e., 
mapped to themselves) іп т. De пе сус (т) as the number of cycles in т. Suppose т 
has b; cycles of length 1, b» cycles of length 2, ..., bj, cycles of length k in its unique 
cycle decomposition. Then т can be encoded as the expression x bi тд? .. a . Sum- 
ming these expressions for all permutations in the group G, and normalizing by the 
number of elements in G results in the cycle index of the group G: 


Prídte gere |: (2.7.1) 
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1. Burnside’s Lemma: Let G be a group of permutations of a set A, and let S be 
the eguivalence relation on A induced by G. Then the number of eguivalence 


classes in A is given by — 5 Inv (т). 


2. Special case of Polya's theorem: Let R be an m element set of colors. Let 
G be a group of permutations {71,72,...} of the set A. Let C(A, R) be the 
set of colorings of the elements of A using colors in R. Then the number of 
distinct colorings in C(A, R) is given by 


LT сус (m1) cyc (72) 
ici [т +m sets 


3. Polya's theorem: Let G be a group of permutations on a set А with cycle index 
Pa (21, 22,..., 24). Let C(A, R) be the collection of all colorings of A using 
colors in R. If w is a weight assignment on R, then the pattern inventory of 
colorings in C(A, R) is given by 


Ра (= w(r), ЫН w (r), 5 52 


EXAMPLES 


1. Consider necklaces constructed of 2k beads. Since a necklace can be ipped over, 

the appropriate permutation group is G = fm,r21 with ті = (1)(2)...(2k) and 
тә = (1 2k) (2 2k — 1j (3 2k — 2) m (k k+ 1). Hence, cyc (1) = 2k, 
сус (тә) = k, and the cycle index is Pg (£1, £2) = (22% + 223) /2. Using r colors, 
the number of distinct necklaces is (r?* + r^)/2. 
For a 4 bead necklace (k = 2) using r = 2 colors (say wi = b for “black” and шә = w 
for “white”), the (2* + 2%) /2 = 10 different necklaces are {bbbb}, {bbbw}, {bbwb}, 
{bbww}, {bwbw}, {bwwb}, {whbw}, {бшшш}, {wbww}, and {wwww}. The pat- 
tern inventory of colorings, Ро (У), wi, У), wi) = ((b+w)* + (9 + ш?)?) /2 = 
b“ + 2b? w + 4®?ш? + 2bw? + w^, tells how many colorings of each type there are. 

2. Consider coloring the corners of a square. If the squares can be rotated, but not re- 
ected, then the number of distinct colorings, using k colors, is 1 (R^ +k? + 2k). If 
the squares can be rotated and re ected, then the number of distinct colorings, using k 
colors, is i (k“ + 2k? + ЗК + 2k). 


(a) If k = 2 colors are used, then there are 6 distinct classes of colorings whether 
re ections are allowed, or not. These classes are the same in both cases. The 16 
colorings of a square with 2 colors form 6 distinct classes as shown: 
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(b) If k = 3 colors are used, then there are 21 distinct classes of colorings if re ections 
are allowed, and 24 distinct classes of colorings if re ections are not allowed. 
Shown below are representative elements of each of these classes: 


b 
MINE 
ЕЁ 


ж НӨ РУ <— include these 3 for по ге ections case 


2.7.9.3 Polya theory tables 


1. Number of distinct corner colorings of regular polygons using rotations and 
re ection s, or rotations only, with no more than k colors: 


rotations & re ections rotations only 
object |k22 k=3 k=4ļ|k=2 k23 k 


triangle 


sguare 
pentagon 


hexagon 


2. Coloring regular 2- and 3- dimensional objects with no more than k colors: 


tetrahedron 
corners of a tetrahedron 5 (kê + 3k“ + 8k?) 
edges of a tetrahedron + (56 + 3k“ + 8k?) 


faces of a tetrahedron + (k + 11k?) 
cube 


corners of a cube (k8 + 17k“ + 6k?) 


faces of a cube 


d. 
24 
edges of a cube эң (k)? + бк" + 3k + 8k“ + 6k?) 
d. 
24 


(kê + ЗА + 12k? + 8k?) 
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corners of a triangle 
with rotations 


with rotations and re ections 


corners of a sguare 
with rotations (kt +k? + 2k) 


(k^ + 2k? + 3k? + 2k) 


with rotations and re ections 


corners of a pentagon 
(k° + 4k) 


with rotations 
(kŠ + 5k? + AK) 


with rotations and re ections 10 
corners of a hexagon 


with rotations 2 (59 + k +2k? + 2k) 
ээ 


with rotations and re ections B (k$ + 3k“ + 4kŠ + 2k? + 2k) 


corners of a regular polygon 


with rotations 


ith rotati d re ecti I d)k* 
with rotations and re ections (n even) um 2. o(d)k4 + 
n 


with rotations and re ections (n odd) 


3. The cycle index Р(ғ,22,...) and number of black-white colorings 
of regular objects under all permutations 


corners of a triangle 
cycle index 2 (ж? + 32,22 + 223) 
pattern inventory 10% + 1b?w + lbw? + 1u? 


corners of a square 
cycle index 3 (21 22222 + 322 + 274) 


1b“ + 153 + 2520)? + lbw? + 1w^ 


pattern inventory 


corners of a pentagon 


cycle index E ho + 415 + 52122) 


pattern inventory 10° + 1b4w + 2b?w? + 2b?w? + 1bw* + 105 
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corners of a cube 


cycle index 4 (2) + 612 + 925 + 82172) 


pattern inventory b8 + b^w + 309w? + 3b°w? + 7544 


+ЗЬ и? + 3bžw9 + bw? + w? 


Note that the pattern inventory for the black-white colorings is given by 
P((b+w), (D? + w), (b? + wž),...). 


2.7.10 TABLES 


2.7.10.1 Number of non-isomorphic groups of different orders 


The 10n + k entry is found by looking at row n. and the column k. There are 
10,494,213 non-isomorphic groups with 512 elements. 


lo 


— 
к5 


о 


> RF го щл VV л QN л [о л 
N 


PE Бә Сл БӘ NY хол са SQ UU I UO Ол En 


кі = о н н e Nee e ка ына ка Ne — 
92 


кі ка N=- -e m.e. Ола ка A NULU н Н 
к. DH RR RN RR RN RR NR RR RF NN I— I 


1 
1 
2 
1 
1 
1 
1 
1 
1 
1 
1 
2 
2 
1 
1 
1 
1 
5 
1 
1 
2 
1 
1 


х= Мә Мә кє мә Мэ Мэ д л к NRK WK NN KN н н 
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tr 


1 
6 
2 
1 
5 
1 
1 
1 
1 
1 
5 
5 
1 
3 
1 
1 
1 
1 
1 
2 
1 
1 
2 
1 
1 
2 
1 
1 
1 


PN Be DY BRR RNR — RFP 49 --1--- NFR М > мю к NY BPR KF NK 
н = = о н н олн [о eUe eNe e NR KN нн н н 


сл 


2.7.10.2 Number of non-isomorphic Abelian groups of different 
orders 


The 10n + k entry is in row n апа column k. 
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2.7.10.3 Names of groups of small order 


Distinct groups of order n 


{е} 
С» 
C3 
C 
Cs 
Ce, Ds 
С? 


Cs, C» х Сд, С» х С» х С», 
Co, Сз х C5 

Cio, Ds 

Сп 

Сі», С» x Cs, T = Сз x C4, 
Сіз 

Си, D7 

Cis 


2.7.10.4 Representations of groups of small order 


In all cases the identity element, {1}, forms a group of order 1. 


1. C5, the cyclic group of order 2 
Generator: a with relation a? = 1 


1 a 
111 a 
Elements Subgroups 
(a) order 2: a (a) order 2: {1, a} 


2. C3, the cyclic group of order 3 
Generator: a with relation a? = 1 


1 
a 
22 
Elements Subgroups 
(a) order 3: a, a? (a) order 3: {1,a,a7} 


3. Са, the cyclic group of order 4 
Generator: a with relation a4 = 1 
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Elements Subgroups 


(a) order 4: a, a” (a) order 4: {1,a,a,a*} 
(b) order 2: a (b) order 2: (1,47) 


4. V, the Klein four group 
Generators: a, b with relations a? = 1, b? = 1, ba = ab: 


Elements Subgroups 


(a) order 2: a, b, ab (a) order 4: {1, a,b, ab} 
(b) order 2: {1, a}, 11,6}, (1, ab} 


5. Се, the cyclic group of order 5 
Generator: a with relation a? = 1 


a н 


e ù N 


a 2989 


Elements Subgroups 


(a) order 5: a, a?, až, a“ (a) order 5: {1,а,а?, aj ae} 


6. Ce, the cyclic group of order 6 
Generator: a with relation a“ = 1 


N 
w 
© 
aj "ы 
5 
сл 


Elements Subgroups 
(a) order 6: a, a? (a) order 6: {1, а,а?,аЗ,а*, a?) 
(b) order 3: as a) (b) order 3: (1, a’, д) 
(c) order 2: a (c) order 2: {1,a?} 
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7. ба, the symmetric group on three elements 
Generators: a, b with relations a? = 1, b? = 1, ba = ab 


Elements 


(a) order 3: a, a? 


(b) order 2: b, ab, a?b 


Subgroups 
(a) order 6: (1, a, a?, b, ab, a7b} (is a normal subgroup) 
(b) order 3: 11,а,а?) (is a normal subgroup) 


(c) order 2: {1,0}, (1, ab), (1,20) 


8. Ст, the cyclic group of order 7 
Generator: a with relation a“ — 1 


1 
а 
až 
až 
at 
až 
48 
Elements Subgroups 
(a) order 7: a, а?, a? , a^, a®, аб (a) order 7: {1, a, a? , à? , a^, a, аб} 


9. Cg, the cyclic group of order 8 


Generator: a with relation аё = 1 

1 a ай a а а? a al 
111 a d а? a* a a 
ala až aš a“ а? a 1 
ela a? a^ а? аё a a 
až | a? at а? аб а" а? 
a“ |а а? аба 1 až 
а |а? a9 a 1 a a) 
a6 | af а" a a? a? 
а la“ 1 a? a? аб 
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Elements Subgroups 


(a) order 8: a, а?, a, a“ (a) order 8: 
(b) order 4: a“, a“ la a? aa zajať sa) 
(c) order 2: a“ (b) order 4: 11,a5.a5.a9) 


(c) order 2: {1,a*} 


10. Ca x Co, the direct product of a cyclic group of order 4 and a cyclic group 
of order 2 


ab аЬ агь 


Elements 


(a) order 4: a, až, ab, a?b 
(b) order 2: а?, b, a?b 


Subgroups 
(a) order 8: (1,2, a2, аз, b, ab, a?b, abi 
(b) order 4: {1,а,а?,а5} (1, ab, a, аг) 11, а2,6,а 5) 
(c) order 2: (1,051, {1,5}, (1,655) 
11. C5 x C5 x C5, the direct product of 3 cyclic groups of order 2 


Generators: a, b, c with relations a“ = 1, b? = 1, c? = 1, ba = ab, ca = ac, 
ch — be 


a b ab с ac be abc 


Elements 


(a) order 2: a, b, ab, c, ac, be, abc 
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Subgroups 
(a) order 8: {1, a, b, ab, c, ac, be, abc} 
(b) order 4: 41, a, b, ab}, {1, a,c, ac}, {1, a, be, abc}, {1, b, c, bc}, 
{1,b, ac, abc}, {1, ab, c, abc}, (1, ab, ac, bc} 
(c) order 2: {1, a}, {1, b}, {1, ab}, (1, c, {1, ac}, {1, bc}, {1, abc} 


12. D4, the dihedral group of order 8 
Generators: a, b with relations a“ = 1, b? = 1, ba = ab 


Elements 


3 


(a) order 4: a, a 
(b) order 2: a?, b, ab, a? b, a?b 

Subgroups 
(a) order 8: (1,2, a?, аг, b, ab, a?b, a? b) 
(b) order 4: (1, a,b, a?b), (1,a, à? , a? V, (1, à?, ab, a?b) 
(c) order 2: {1,0}, (1, à?b), (1,a?), (1, ab}, {1,a7b} 


Normal subgroups 


(a) order 8: 11, а,ад, a,b, ab, a?b, a? b] 
(b) order 4: (1, а?, Б, ab}, {1,a,a7,a°}, (1, à?, ab, a3b} 
(c) order 2: 11,45) 


13. Q, the quaternion group (of order 8) 
Generators: a, b with relations a“ = 1, b? = a’, ba = аЬ 


Elements 


(a) order 4: a, a?, b, ab, a? b, a?b 
(b) order 2: a? 
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Subgroups 
(a) order 8: (1,2, a2, aè, b, ab, a b, a? + 

(b) order 4: (1,a,a?, a? ), (1,6, a?,a?6], (1, ab, a?, аЬ) 
(c) order 2: 11,45) 

Normal subgroups 
(a) order 8: (1,2, a2, a,b, ab, ab, a? + 
(b) order 4: {1,а,а?,а?}, {1,0,а?, а2Ь}, (1, ab, a’, a®b} 
(c) order 2: 11,45) 

Notes 


е Q can be de ned as the set (1, — 1,4, —i, j, — j, k, —k} where multiplica- 
tion 1s de ned by: 


1 = = k“ = —1, ij — —ji =k, jk = —kj =i, ki = —ik = j 
(2.72) 


х|+1 -1 +i -i +j -j +k -k 


Elements 

(a) order 4: 1, —i, j, —3, k, —k 

(b) order 2: —1 

Subgroups (all of them are normal subgroups) 

(a) order 8: (1, —1, i, —i, j, —j, k, —k} 

(b) order 4: (1,4, —1, —i}, {1, j, -1, -j 11,k,—1,—k+ 
(c) order 2: (1, —1} 


Q can be de ned as the group composed of the 8 matrices: 
10 -1 0 -1-4 0 sou [e 10 
нъ арен а [ost o рене Aj 
О ОПЕ [A mE EDU. AJ. ters (> S 
Na (а ааа | 


where a subscript of g indicates a quaternion element, i? = —1, and 
matrix multiplication is the group operation. 
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14. Со, the cyclic group of order 9 
Generator: a with relation a? = 1 
1 


со 
[^w 
сл 
о 
E 
00 


a a^ a^ a? a? a" a 
111 a a^ a^ œ a 

ala а? a^ a? a a 
a?|a? a? a? а а? a 

a? |a? at аб a a 

a^ | af а? a aè 

a? | а? a6 a 1 

a6 | аё а" a 

а |а aš а? 

аё |a 1 a? 


Elements 
(a) order 9: a, a?, а“, a“, аё, a? 


(b) order 3: a?, a“ 
Subgroups 


(a) order 9: {1,а,а?,аЗ,а%,‚а5,аб5,а!,а5} 
(b) order 3: 11, 62,091 


15. C3 x C3, the direct product of two cyclic groups of order 3 
Generators: a, b with relations a? = 1, b? = 1, ba = ab 


Elements 
(a) order 3: a, a?, b, ab, ab, b, ab? , а252 
Subgroups 
(a) order 3: (1,a,a?), {1,b,67}, (1, ab, a?0? Y, {1,a7b, ab?) 
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16. Cio, the cyclic group of order 10 


Generator: a with relation a!“ = 1 
ЕСЕГЕ gS ag 


a a“ а? a a a a a a 
111 a až a^ a? a a a? a 
ala d a^ a? аб а? аё a? 1 

ela a? až аб a аё a 1 a 

až | aè at аб a aš а 1 a а 

a^ | af а? a) а a? 1 a a a 

a? | až аб а а 1 a a aš a! 

a6 | аб а" a) 1 a až а a a 

а |а aš 1 a а? аз ад a af 

аё | аё а? a až aš a) а? as а" 

а |а 1 až a? a) а? а a aš 


Elements 


9 


(a) order 10: a, a“, a", a 
(b) order 5: a, a“, a“, a? 
(c) order 2: a? 


Subgroups 


(a) order 10: 11,2,02,0*,a*, a? za? a аа?) 
(b) order 5: (1, а?,а?, аб, а? + 
(c) order 2: {1,a°} 


17. Ds, the dihedral group of order 10 
Generators: a, b with relations а? = 1, b? = 1, ba = а! 


Elements 


(a) order 5: a, a?, až, a“ 


(b) order 2: b, ab, a?b, a?b, atb 


Subgroups 
(a) order 10: (1, a, a? , a? , a*, b, ab, a?b, a?b, a^ b] 
(b) order 5: (1,a,a?, a?, ай 


(c) order 2: {1,0}, (1, ab} (1,a?b], (1, 251, 11,445) 
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Normal subgroups 
(a) order 10: {1,a,a?,a?,a*,b, ab, ab, ab, a‘b} 
(b) order 5: {1, а,а?,а?, ай } 
18. Dg, the dihedral group of order 12 


The multiplication table for Dg (given below) 
Generators: a, b with relations a“ = 1, b? = 1, ba = а! 


1 a ай аз a a b ab аЬ аЬ afb ab 

1 1 a a a a a 
a a a a a 1 
až | až a a a 
a? | a? a 

a^ | af 

а? | a? 

b b 

ab | ab 

a?b | a?b 

a?b | а? 

a^b | a“b 

a?b | a“b 

Elements 


(a) order 6: a, a? 


(b) order 3: a“, a“ 
(c) order 2: až, b, ab, a? b, ab, a“b, a®b 


Subgroups 
(a) order 12: {1,a,a?,a?,a*,a°,b, ab, аЬ, a? b, a* b, а5Ь} 
(b) order 6: {1,а,а?,а?, a*, a9] (1, аг, a*, b, a? b, a^ b), 
(1, аг, ас, ab, a?b, a? b) 
(c) order 4: (1, à?, b, a?b), (1, a?, ab, ab}, (1, a? , a? b, 75) 
(d) order 3: {1,a?,a*} 
(e) order 2: {1,a?}, {1,b}, {1, ab}, (1, à?b), (1,425), 11, 445), 
{1,a°b} 
Normal subgroups 
(a) order 12: {1,a,a?,a?,a*,a°,b, ab, a?b, a? b, a* b, a°b} 
(b) order 6: (1,a,a?, a?, a*, a? ), (1, a2, a^, b, à? b, atb}, 
(1, 2, a*, ab, ab, a°b} 
(c) order 3: {1,а2, а} 
(d) order 2: 41,а? } 


Conjugacy classes: 111, {aè}, {a, ač}, (a, ай }, {b, ab, atb}, {ab, a?b, a°b} 
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19. Z3 х Z4, the semidirect product of a cyclic group of order 4 acting on a 
cyclic group of order 3 (Note: х denotes the semidirect product.) 
Generators: а, b with relations a“ = 1, b? = a?, ba = ab 


© 


až 
až 
a“ 
až 


o oh 
e 


Elements 


(a) order 6: a, a? 


(b) order 4: b, ab, a?b, a?b, a^b, a®b 
(c) order 3: až, а“ 
(d) order 2: a? 
Subgroups 
(a) order 12: (1,2, a2, a? , a^, a5, b, ab, a?b, a? b, a* b, а5Ь} 
(b) order 6: (1,2, a°, аг, a*, a? 
(c) order 4: (1, 5, a?, a°b}, (1, ab, a?, ab], (1, a? 6, a? , аЬ) 
(d) order 3: {1,а?,а*} 
(e) order 2: (1,021 
Normal subgroups 
(a) order 12: (1, a, a?, a? , a*, a? , b, ab, a?b, a?b, a*b, a? b] 
(b) order 6: (1,a, a?, a?, a*, а? } 
(c) order 3: {1,а?,а*} 
(d) order 2: 11,43) 
Conjugacy classes: 111, fa“): Га, ač}, (a, ай }, {b, a?b, atb}, {ab, a?b, a°b} 


e Alternate representation, the group can be presented as follows, 
Generators: r, y with relations r? = 1, y* = 1, yz = x“!y 
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Elements 


(a) order 6: 22) ry? 

(b) order 4: y, zy, xy, y? , ry, 23 
(c) order 3: x, 22 

(d) order 2: y? 


Subgroups 

(a) order 12: {1, £, 2°, y, £y, £’y, y’, oy e v ry’, an d 
(b) order 6: (11 z, y^ e^ ту”? 

(c) order 4: {1,y,y7,y?}, 11, жу, y’, жу? }, (oy y’, ry) 
(d) order 3: Vleet 

(е) order 2: {1,y?} 


Normal subgroups 


(a) order 12: {1, £, 2°, ga Y’, TY’, р 
(b) order 6: 1 275208 r, cy } 

(c) order 3: Tint) 

(d) order 2: 11,2) 


Conjugacy classes: 111, (453, Iu {ry ry}, {y vý x’ y}, 
(93, ry“, 22у?) 


20. A4, the alternating group оп 4 elements 


Generators: a, b, c with relations a? = 1, b? = 1, c? = 1, ba = ab, ca = abc, 
ch — ac 
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Elements 


1. order 3: c, ac, be, abc, c? , ac, bež, abc? 
2. order 2: a, b, ab 


Subgroups 
1. order 12: (1, a,b, ab, c, ac, bc, abc, c), ac? bc”, abc? 1 
2. order 4: {1, a, b, ab} 
3. order 3: {1,с, с? }, {1,ас, Ье? |, (1, bc, abc}, {1, abc, ас?) 
4. order 2: {1,a}, (1,6), {1, ab} 


Normal subgroups 


1. order 12: {1,a,b, ab, с, ac, bc, abc, e, ас? be? abe?) 
2. order 4: {1, a, b, ab} 


Conjugacy classes: {1}, {a, b, ab}, (c, ac, be, abc}, le, ac? be, abc? } 


2.7.10.5 Small nite elds 


In the following, the entries under a“ denote the coef cien t of powers of a. For 
example, the last entry of the p(z) = z? + x? + 1 table is 1 1 0. That is: a“ = 
la? + la! + 0a? modulo pla), where the coef cien ts are taken modulo 2. 
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2.7.10.6 Addition and multiplication tables for F5, F3, F4, and Fk 


1. F addition and multiplication: 


+10 
010 
111 


о =|= 


2. F3 addition and multiplication: 


N= Ol + 


1 a a +1 
1 a a +1 
0 a +1 a 
a +1 0 1 
a 1 0 


4. Fg addition and multiplication (using strings of Os and 1s to represent the 
polynomials: 0 = 000, 1 = 001, a = 010, a +1 = 011, a? = 100, 
a? +a = 110,0? +1 = 101,02 +a +1 = 111): 


+ |000 001 010 011 100 101 110 111 


000 001 010 011 100 101 110 111 


110 
111 
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2.7.10.7 Linear characters 


A linear character of a nite group С is a homomorphism from С to the multiplica- 
tive group of the non-zero complex numbers. Let x be a linear character of G, the 
identity of G and g,h € G. Then 


xl) =1 
x(g x h) = x(g)x(h) 
x(g) = ейтік/т for some integer k, where n is the order of g 
x(g~') = х(9) 


The trivial character of С maps every element to 1. If x1 and x» are two linear 
characters, then so is x = x1x» de ned by x(g) = x1(g)x2(g). In fact, the linear 
characters form a group. 


Zn Form =0,1,...,n— 1l, Xm: km er? 


G Abelian G = Zn, X Zn X +++ X Zn; with each n; a power of a prime. 
Form; =0,1,...,nj — l and gj = (0,...,0,1,0,...,0) 
Xma,ma,.. m, € gj H eimi fna 


+1 ifn even, 
1 ifn odd, 
Xz,y ah ж,Ь > y. (See de nitio n of Dn.) 


D,, dihedral For x = +1, y = 


Quaternions For x + 1 and y = +1 or F1, 
0 1 
Ха,у : —1 0 e T, Ха,у : 


Sn symmetric | The trivial character and sgn, where sgn is the signum function 
on permutations. (See Section 1.8.2.) 


-4 


2.7.10.8 Listof all sporadic nite simple groups 


These are the sporadic nite simple groups that are not in any of the standard classes 
(see page 162). 


45.11 
45.11 
5.7.11 


0.711: 23 
210.33.5. 7. 11-23 


22.3.5. 7- 11-19 
Bl a da aes 
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27.35. 5.17: 19 
221 „39 .5.7.119 23.29: 31-3743 
29.32.59. 7.11 


27.36.53.11 

213 .37.52.7.11-13 
214.33 2535751329 

210 . 33.52.73.17 
28.37.56.7.11.31.37.67 


29.34.5.73.11.19.31 


.39.54.72.11.13.93 
36.58 .7.11.23 
-37-57-7-11-23 
.39.52.7.11.13 


-315.52.7-11-13-17-23 

316. 52. 73.11.1323 - 29 

-310 . 53 . 72. 13. 19. 31 
:36.56.7.11.19 

„315. 56 . 72.11.13 17: 19.23: 31: 47 


320.59. 76 . 11? . 133 . 17 - 19.23.29. 31-41: 47: 59-71 


2.7.10.9 Indices and power residues 


For 7% the following table lists the index (order) of a and the power residues а, а 2 
., ajndex(a) — 1 for each element a, where (a,n) = 1. 


Group | Element | Index Power 
residues 
Zo 


1 
2,4,8,5,10, 
9,7,3,6, 
3,9,5,4, 
4,5,9,3, 
5,3,4,9, 
6,3,7,9,10, 
5,8,4,2, 
7,5,2,3,10, 
4,6,9,8, 
8,9,6,4,10, 
3.2.5.1: 
9,4,3,5, 
10,1 
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2.7.10.10 Power residues in 27, 


For prime p < 40, the following table lists the minimal primitive root a and the 
power residues of a. These can be used to nd a™ (mod р) for any (a, p) = 1. For 
example, to nd 3" (mod 11) (a = 3,m = 7), look in row р = 11 until the power 
of a that is egual to 3 is found. In this case 2% — 3 (mod 11). This means that 
37 = (28)! = 256 = (2105.56 = 26 = 9 (mod 11). 


ope pre — 
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2.7.10.11 Table of primitive monic polynomials 


In the table below, the elements in each string are the coef cients of the polynomial 
after the highest power of r. (For example, 564 represents r? + 5z? + 6x + 4.) 
Р, 0 
11 
011 101 
0011 1001 
00101 01001 01111 10111 11011 11101 
000101 011011 100001 100111 101101 110011 


0 
12 


2.7.10.12 Table of irreducible polynomials іп 22[2] 


Each polynomial is represented by its coef cients (which are either 0 or 1), beginning 
with the highest power. For example, z^ + x + 1 is represented as 10011. 


degree 1: 10 11 

degree 2: 111 

degree 3: 1011 1101 

degree 4: 10011 11001 11111 

degree 5: 100101 101001 101111 110111 111011 111101 

degree 6: 1000011 1001001 1010111 1011011 1100001 1100111 
1101101 1110011 1110101 


degree 7: 10000011 10001001 10001111 10010001 10011101 10100111 
10101011 10111001 10111111 11000001 11001011 11010011 
11010101 11100101 11101111 11110001 11110111 11111101 


degree 8: 100011011 100011101 100101011 100101101 100111001 100111111 
101001101 101011111 101100011 101100101 101101001 101110001 
101110111 101111011 110000111 110001011 110001101 110011111 
110100011 110101001 110110001 110111101 111000011 111001111 
111010111 111011101 111100111 111110011 111110101 111111001 
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2.7.10.13 Table of primitive roots 


The number of integers not exceeding and relatively prime to the integer n is ¢(n) 
(see page 128). These integers form a group under multiplication module n; the 
group is cyclic if, and only if, n = 1,2,4 or n is of the form p^ or 2р“, where р is 
an odd prime. The number g is a primitive root of n if it generates that group, i.e., if 
{g, 9°, ..., 901 are distinct modulo n. There are Ф(Ф(п)) primitive roots of n. 


1. If g is a primitive root of p and Р #1 (mod p°), then g is a primitive root 
of p* for all k. 


2. If g?-! = 1 (mod р?) then g + pis a primitive root of p* for all k. 


3. If g is a primitive root of p^, then either g or g + p*, whichever is odd, is a 
primitive root of 2р“. 


4. If g is a primitive root of n, then g^ is a primitive root of n if, and only if, k 
and ф(п) are relatively prime, i.e., (¢(n),&) = 1. 


In the following table, 


e g denotes the least primitive root of p 
e G denotes the least negative primitive root of p 
ec denotes whether 10, — 10, or both, are primitive roots of p 
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2.7.10.14 Table of factorizations of x" — 1 


n Factorization of r" — 1 mod2 


1+2+2> +r? +25 + 15 + 25) 
1+2) (1+?) (1+2“) 
1+х+°?) (1+ a? + 25) 
2. g? + at) (1+2 +17 +19 +15) 


о NUDOU & VU KE 


12 

ae 02") 
Ee ci (1— zz? — 29+ 15 — x9 + 2“) 
lctzci?-Rxr-4xr +2 + 25) 
—1+2) (1(+ж+?) (l+a+2? +19 + x“) 
1— x + x3 — x) + x5 — x7 + a? 
—1+ 7) (1+ x) (1+ 27) (1+ z^) (1+ 23) 
—1 + x) (56 52°) 
—1 +x) (1+2) (1- z+’) (1+ 7+ 2?) (1— 2? + 25) (1+ 22 + 2“) 
—1 + x) o б) 
—1+%)(1+%)(1+ 77) (1- z c à? — x + 1“) 
14-7 +18 +14) (1— x + 7“ — 16 + 2%) 
-1-2)Є(1424225)(1-:422 +r? + x) + 2 + 15) 
1—x +g? — a) + a9 — 19 +19 — x)! + 21?) 
—1 +z) (1 — z +z? — 29 + gt — 2° +28 — a +28 — a? +20) 

) (L+ zz? +r? + art ba +r? 4274+ 08 +29 + 19) 

—1 + x) b» d ТЫ, 
-1+ 2) (1+2) (12-22) (1— x 2?) (1+2+а2) (1+ x“) 
1— x7 + x“) (1— x“ + x? 
—1- zx) (1-5 zz? +123 + at) (1+ a? + 210 +r + 220) 
—1+ ж) (1+2) 
1— x +1? — 2 +1) — z» + 26 — 17 + 19 — 19 + 119 gH + 112 
lteter? +r? bab ba had ba tah +29 + 0710 Hr +12) 
—1- zc) (1-5 zz?) (1+ à? + 2°) (1+ 29 + 215) 
ЛЕНІ к (1—z 4 2? — a? 4 z* — x5 + 10 
l+ete?+a%+a44+2° +216) (1-22 + 15 — 19 +08 — 110 + 172) 
—1 + x) (у ga) 
-1 +z) (1+2) (1- z+?) (1+a24+27) (1— x +2? — r? + x) 
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3.1 SYMBOLIC LOGIC 


3.1.1 PROPOSITIONAL CALCULUS 


Propositional calculus is the study of statements: how they are combined and how 
to determine their truth. Statements (or propositions) are combined by means of 
connectives such as and (^), or (V), not (~, or sometimes ~), implies (—), and if 
and only if (+). Propositions are denoted by letters {p,q,r,...}. For example, 
if p is the statement “x = 3", and g the statement “y = 4", then p V ^q would be 
interpreted as “r = З огу # 4". To determine the truth of a statement, truth tables 
are used. Using T (for true) and F (for false), the truth tables for these connectives 
are as follows: 


p а |р^а рма pq реф p p 
T T| T T T T T F 
T F| F T F F F T 
F T| F T T F 
F F| F F T T 


The proposition р — 4 can be read “If p then q” or, less often, “g if p”. The 
table shows that “p V q” is an inclusive or because it is true even when p and q are 
both true. Thus, the statement “I’m watching TV or I’m doing homework” is a true 
statement if the narrator happens to be both watching TV and doing homework. Note 
that p — q is false only when р is true and g is false. Thus, a false statement implies 
any statement and a true statement is implied by any statement. 


3.1.2 TAUTOLOGIES 


A statement such as (p —> (q A r)) V ^p is a compound statement composed of 
the atomic propositions p, g, and т. The letters P, Q, and В are used to designate 
compound statements. A tautology is a compound statement which always is true, 
regardless of the truth values of the atomic statements used to de ne it. For example, 
a simple tautology is (--р) <-> p. Tautologies are logical truths. Some examples 
are as follows: 


Law of the excluded middle pV ~р 

De Morgan's laws a(pV д) — (9p ^q) 
(рл) < (op V ^q) 

Modus ponens (рл (р 9)) >q 

Contrapositive law (p > 4) — (^q > —p) 

Reductio ad absurdum (ap > р) > p 

Elimination of cases ((pV q) Aap) > g 

Transitivity of implication — ((p—g)A(4—r)) > (рә r) 

Proof by cases ((0 34) л (<р 4)) >q 
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Idempotent laws 
Commutative laws 


р^р < р; рур < p 


(p ^q) 4-9 
Associative laws (рл (qAr)) 
( 


pV (qVr)) < 


(q^ p); (руч) — (aV p) 
— ((p^q) ^ 2 


((р V q) V 


3.1.3 TRUTH TABLES AS FUNCTIONS 


If we assign the value 1 to T, and 0 to F, then the truth table for p A g is simply the 
value pq. This can be done with all the connectives as follows: 


Connective 


Arithmetic function 


руд 
pq 
p> q 
=p 


p+q -pq 

1- p+ pg 

1 — p- g + 2р9 
1—р 


These formulae may be used to verify tautologies, because, from this point of view, 
a tautology is a function whose value is identically 1. In using them, it is useful to 
remember that рр = р? = p, since p = 0 or p = 1. 


3.1.4 RULES OF INFERENCE 


A rule of inference in propositional calculus is a method of arriving at a valid (true) 
conclusion, given certain statements, assumed to be true, which are called the hy- 
potheses. For example, suppose that P and Q are compound statements. Then if P 
and P — Q are true, then Q must necessarily be true. This follows from the modus 
ponens tautology in the above list of tautologies. We write this rule of inference 
P, Р Q > Q. It is also classically written 


Р 
Р-0 
Q 


Some examples of rules of inferences follow, all derived from the above list of 
tautologies: 


Modus ponens Р,Р-0-0 
Contrapositive Р-0-»-0-4-Р 
Modus tollens Р 3,-0 > -P 
Transitivity Р-О,ООВ-Р-В 
Elimination of cases РУ (),-Р > 0 

“Апа” usage PAQ > P,Q 
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3.1.5 DEDUCTIONS 


A deduction from hypotheses is a list of statements, each one of which is either one of 
the hypotheses, a tautology, or follows from previous statements in the list by a valid 
rule of inference. It follows that if the hypotheses are true, then the conclusion must 
be true. Suppose, for example, that we are given hypotheses ^q — р, q — ^r, т; it 
is required to deduce the conclusion p. A deduction showing this, with reasons for 
each step is as follows: 


Statement Reason 


1. qr Hypothesis 
22:08 Hypothesis 
3. ~q Modus tollens (1,2) 
4. —9—p Hypothesis 
5. p Modus ponens (3,4) 


3.1.6 PREDICATE CALCULUS 


Unlike propositional calculus, which may be considered the skeleton of logical dis- 
course, predicate calculus is the language in which most mathematical reasoning 
takes place. It uses the symbols of propositional calculus, with the exception of the 
propositional variables р, g, .... Predicate calculus uses the universal quanti er V, 
the existential quanti er 3, predicates P(x), Q(x,y),..., variables x,y,..., and 
assumes a universe U from which the variables are taken. The quanti er s are illus- 
trated in the following table. 


Symbol Read as Usage Interpretation 
Е There exists an 3z(x > 10) There is an z such that z > 10 
V For all Va(a? +10) Forallz,z? +140 


Predicates are variable statements which may be true or false, depending on the 
values of its variable. In the above table, “r > 10" is a predicate in the one variable 
x as is "z^ +1 40”. Without a given universe, we have no way of deciding whether 
a statement is true or false. Thus Vz(z? + 1 Z 0) is true if the universe U is the 
real numbers, but false if U is the complex numbers. A useful rule for manipulating 
quanti ers is 

2V2 P(x) <> AraP(2). 


For example, it is not true that all people are mortal if, and only if, there is a person 
who is immortal. Here the universe U is the set of people, and P(x) is the predicate 
“x is mortal”. This works with more than one quanti er . Thus, 


WadyP(2,y) < 3xVyAP(z,y). 


For example, if it is not true that every person loves someone, then it follows that 
there is a person who loves no one (and vice versa). 

Fermat’s last theorem, stated in terms of the predicate calculus (U = the positive 
integers), is 
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VnVaNbNe|(n > 2) 3 (а +6" z c")]. 


It was proven in 1995; its proof is extremely complicated. One does not expect a 
simple deduction, as in the propositional calculus. 

In 1931, Godel proved the Gódel Incompleteness Theorem. This states that, in 
any logical system complex enough to contain arithmetic, it will always be possible 
to nd a true result which is not formally provable using predicate logic. This result 
was especially startling because the notion of truth and provability had been often 
identi ed with each other. 


3.2 SET THEORY 


3.2.1 SETS 


A set is a collection of objects. Some examples of sets are 


1. The population of Cleveland on January 1, 1995 
. The real numbers between О and 1 inclusive 

. The prime numbers 2, 3, 5, 7, 11, ... 

. The numbers 1, 2, 3, and 4 

. All of the formulae in this book 


л > оо го 


3.2.2 SET OPERATIONS AND RELATIONS 


If x is an element in a set A, then we write x € A (read “z is in A”). If x is not in 
A, we write x £ A. When considering sets, a set U, called the universe, is chosen, 
from which all elements are taken. The null set or empty set () is the set containing 
no elements. Thus, x ¢ 0 for all т € U. Some relations on sets are as follows: 


Relation Read as De nition 
ACB Aiscontainedin В Any element of A is also an element of В 
А-В Aequals В (AC B)A(B C A) 


Some basic operations on sets are as follows: 


Operation Read as De nition 

AUB А union B The elements in А or in В 

AnB А intersection B The elements in both A and B 

A—B А minus B The elements in А which are not in В 

A' or Aor AC Complement of A The elements in U which are not in A 

P(A) or 24 Power set of A The collection of all subsets of A 

ASB Symmetric difference of The elements of A and B that are not 
A and B in both A and B (і.е., the union 


minus the intersection) 
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3.2.3 CONNECTION BETWEEN SETS AND PROBABILITY 


Set concept Probability concept 
Set Event 
Set containing a single element Indecomposable, elementary, or 

atomic event 
Set containing more than one Compound event 
element 

Universal set or space Sample space 
Complement of a set Non-occurrence of an event 
Function on the universal set Random variable 
Measure of a set Probability of an event 
Integral with respect to Ше measure Expectation or expected value 


3.2.4 VENN DIAGRAMS 


The operations and relations on sets can be illustrated by Venn diagrams. The dia- 
grams below show a few possibilities. 


C NED D 
(1 © 


AcB 
Venn diagrams can be constructed to show combinations of 
many events. Each of the 2“ regions created by the rectangles in 
the diagram to the right represents a different combination. 


3.2.5 PARADOXES AND THEOREMS OF SET THEORY 
3.2.5.1 Russelľs paradox 


In about 1900, Bertrand Russell presented a paradox, paraphrased as follows: since 
the elements of sets can be arbitrary, sets can contain sets as elements. Therefore, a 
set can possibly be a member of itself. (For example, the set of all sets would be a 
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member of itself. Another example is the collection of all sets that can be described 
in fewer than 50 words.) Now let A be the set of all sets which are not members of 
themselves. Then if A is a member of itself, it is not a member of itself. And if A 
is not a member of itself, then, by de nitio n, A is a member of itself. This paradox 
leads to a much more careful evaluation of how sets should be de ned . 


3.2.5.2 In nite sets and the continuum hypothesis 


Georg Cantor showed how the number of elements of in nite sets can be counted, 
much as nite sets. He used the symbol No (read “aleph null") for the number of 
integers and introduced larger in nite numbers such as N1, Хә, and so on. Cantor in- 
troduced a consistent arithmetic on in nite cardinals and a way of comparing in nite 
cardinals. A few of his results were as follows: 


No + No = No, (No)? = No, 2%о — о > No. 


Cantor showed that c = 2% > No, where c is the cardinality of real numbers. 
The continuum hypothesis asks whether or not c = Хү, the rst іп nite cardinal 
greater than No. In 1963, Paul J. Cohen showed that this result is independent of the 
other axioms of set theory. In his words, “... the truth or falsity of the continuum 
hypothesis ... cannot be determined by set theory as we know it today". 


3.2.6 INCLUSION/EXCLUSION 


Let fa1,2,...,a,. + be properties that the elements of a set may or may not have. If 
the set has N objects, then the number of objects having exactly m properties (with 
m € т), €m, 18 given by 


m +1 m + 2 m + З 
Em = 8m 7 5m+1 + 85m +2 7 Sm43 t... (3.2.1) 
1 2 3 
m +p -m fm + (r ^m) 
.444-1) ... (21) 77M : 
+(e ШТ (А, 
Here 8; = >) N (di, ai, +++ @;,) is the number of elements that have a;,,.... When 
m = 0, this is the usual inclusion/exclusion rule: 
eo = 80 — 81 + 82 —+++ + (—1)'ву, 
(3.2.2) 
=N- > №(а) + У М(аа)- X N(aiajax) + 
4 i, j distinct i, j, Ё distinct 


3.2.7 PARTIALLY ORDERED SETS 


Consider a set S and a relation on it. Given any two elements x and y in S, we can 
determine whether ог not x is “related” to y; if it is, “a < y". The relation “<” will 
be a partial order on S if it satis es the following three conditions: 


re e xive 8 < s for every s € S, 
antisymmetric s Stand £ < s imply s = t, and 
transitive s ~tandt < u imply s < u. 
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FIGURE 3.1 
Left: Hasse diagram for integers up to 12 with т < y meaning “the number x divides the 


number y". Right: Hasse diagram for the power set of {a,b,c} with x < y meaning “the set 
т is a subset of the set y". 


If < is a partial order on S, then the pair (S, <) is called a partially ordered set 
or a poset. Given the partial order < on the set S, de ne the relation < by 


2-0) 1f and only if z yandz Fy. 


We say that the element t covers the element s if s < t and there is no element u 
with s < u < t. A Hasse diagram of the poset (S, <) is a gure consisting of the 
elements of S with a line segment directed generally upward from s to t whenever t 
covers s. (See Figure 3.1.) 

Two elements 2 and y in a poset (5, X) are said to be comparable if either x < y 
or y < x. If every pair of elements іп a poset is comparable, then (S, <) is a chain. 
An antichain is a poset in which no two elements are comparable (1.е., © < y if and 
only if x = y for all x and y in the antichain). A maximal chain is a chain that is not 
properly contained in another chain (and similarly for a maximal antichain). 


EXAMPLES 


1. Let S be the set of natural numbers up to 12 and let “r < у” mean “the number 
т divides the number y". Then (5, <) is a poset with the Hasse diagram shown in 
Figure 3.1 (left). Observe that the elements 2 and 4 are comparable, but elements 2 and 
5 are not comparable. 


2. Let S be the set of all subsets of the set {a,b,c} and let ^x < y" mean “the set x 
is contained in the set y". Then (S, X) is a poset with the Hasse diagram shown in 
Figure 3.1 (right). 

3. There are 16 different isomorphism types of posets of size 4. There are 5 different 
isomorphism types of posets of size 3, shown below: 


© 
o 


a b c a a 


a 
еее Ф 
ө b 
с 
с 


o 
o 
о 
о 
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3.3 COMBINATORICS 


3.31 SAMPLE SELECTION 


There are four diffeent ways in which a sample of r elements can be obtained from 
a setof n distinguishable objects. 


Order | Repetitions The sample is called an Number of ways to 

counts? allowed? choose the sample 
r-combination C(n,r) 
r-permutation P(n,r) 
r-combination with replacement С P (n, т) 


r-permutation with replacement — PP (n, r) 


an (3.3.1) 


CR(n,r) = C(n +r—1,r) = (n+r—1)! 


dover ed 


PF(n,r) = п". 


EXAMPLE There are four ways to choose a 2-element sample from the set fa, b}: 


r-combination C(2,2)=1 ab 

r-permutation P(2,2) 22 abandba 
r-combination with replacement C7(2,2) — 3 aa, ab, and bb 
r-permutation with replacement — P7 (2,2) 2 4 аа, ab, ba, and bb 


3.3.2 BALLS INTO CELLS 


There are eight different ways in which n balls can be placed into Ё cells: 


Distinguish Distinguish Сап cells Number of ways to 
the balls? the cells? be empty? place n balls into k cells 


{у came ats 
UJ 


k+n — 1,n) = аха 


n 


n-=1,k-—1)= (72) 


n) + p(n) +... + p(n) 
n) 


( 
( 
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where (7) is the Stirling subset number (see page 213) and p; (n) is the number of 
partitions of the number n into exactly k integer pieces (see page 210). 

Given n distinguishable balls and Ё distinguishable cells, the number of ways in 
which we can place n balls into cell 1, na balls into cell 2, ..., ng balls into cell k, 


is given by the multinomial coef cien t 18 A. p (see page 209). 


EXAMPLE Consider placing n = 3 balls into k = 2 cells. Let {A, B, C denote the 
names of the balls (when needed) and {a,b,c} denote the names of the cells (when 
needed). A cell will be denoted like this. Begin with: Are the balls distinguishable? 


1. Yes, the balls are distinguishable. Are the cells distinguishable? 
(a) Yes, the cells are distinguishable. Can the cells be empty? 


i. Yes. Number of ways is k” = 2% = 8: ABC||ABC 
1>-lhb.——i 


ши 


а b a b 
on ot LL > LII LI LII Li 


ii. No. Number of ways is k! А = = 211 


LLL LII 
b b 


(b) No, the cells are not distinguishable. Can the cells be empty? 
i. Yes. Number of ways is 111 елы GI = ey + {5} =14+3=4: 


LI 1-- LI LII LI —л LI LIÉ 


ii. No. Number of ways is i == {з} — 3: 


2. No, the balls are not distinguishable. Are the cells distinguishable? 


(a) Yes, the cells are distinguishable. Can the cells be EE 


i. Yes. Number of ways is ( а 1) = 


ii. No. Number of ways is = |) = = 


(b) No, the cells are not distinguishable. Can Ше cells be empty? 
i. Yes. Number of ways is pı (п) +... +pi(n) = р: (3) +p2(3) = 1+1 = 2: 


eme 
ii. No. Number of ways is py (n) = p»(3) = 1: ЕС 
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3.3.3 BINOMIAL COEFFICIENTS 


The binomial coef cient C(n,m) = (2) is the number of ways of choosing m 
objects from a collection of n distinct objects without regard to order: 


EXAMPLE For the 5 element set (a,b, c, d, e} there are (2) = sir = 10 subsets con- 


taining exactly three elements. They are: 


{a,b,c}, {a,b,d}, {a,b,e}, {a,c,d}, {a,c,e}, 
{a,d,e}, (bod, {b,c,e}, {b,d,e}, {c, d,e}. 


Properties of binomial coef cients include: 


N 
Р 
© з 
po. 
[| 
ы. 
= з 
мы 
Il 
= 
о 
5 
с. 
TN 
= 3 
LR. 
[| 
3 


59 


U) 223 2п-00! 2901 — DEn—3) 3-1 


n n! n! 


4. If n and m are integers, and m > n, then (21 - 0. 


5. The recurrence relation: ("+") -1(7)-4,7,). 


6. Two generating functions for binomial coef cients are eee (2) go 
(L4 a)? forn 1,222 and »,, (gum ces 


m 


22 faty =. (x y 
7. The Vand а lut 4 | 
е Vandermonde convolution is ( РЯ ) 2% @ Ё = 3 


3.3.3.1 Pascaľs triangle 


The binomial coef cien ts (0) can be arranged in а triangle in which each number is 


the sum of the two numbers above it. For example (3) = (2) + (б): 


1 0 
ёс 0 
1 : Бү? 5 1 (a) g () 
1 : о. : 1 Ü B B (;) 
1 3 28 56 70 56 28 8 1 (9 В 2 (9 В 
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3.3.3.2 Binomial coef cient relationships 


The binomial coef cien ts satisfy 


44. 


| 
( 
( 
(т) = (0) +) 6) OQ. 

= (0) +0) ++ Č): 

0 (5) - (2) + «car forn > 1, 
3-0 forn > 1, 
p= (1) + Jr forn > 1, 

0-і 1) -25) ++ Dra 7) forn > 1. 


3.3.4 MULTINOMIAL COEFFICIENTS 


The multinomial coef cien t 09 OA x] (also written C (n; n1,n»,...,nj)) is the 


number of ways of choosing nı objects, then na objects, ..., then n; objects from a 
collection of n distinct objects without regard to order. This requires that Ya nj — 
n. The multinomial symbol 1s numerically evaluated as 


| 
" d (3.32) 
ni,n3,..., Пр milna! +++ ny! 


EXAMPLE The number of ways to choose 2 objects, then 1 object, then 1 object from 


the set (a, b,c, d} 18 G : ij — 12; they are as follows (vertical bars show the ordered 


selections): 
Jablc|d|,  j|ab|d|c],  jae|b|d|, | | ac | d| |, 
Jad|b|c|,  [|ad|c|b], — |belaldl, — | be | dj a|, 
| bd |а | c |, | bd | c | a |, [са | a | b |, | ed | 6 |a |. 
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3.3.5 ARRANGEMENTS AND DERANGEMENTS 


The number of ways to arrange n distinct objects in a row is n!; this is the number of 
permutations of n objects. For example, for the three objects fa, Б, с}, the number 
of arrangements is 3! = 6. These permutations are: abc, bac, cab, acb, bea, and cba. 

The number of ways to arrange n objects (assuming that there are k types 
of objects and n; copies of each object of type 2) is the multinomial coef cien t 
РИТЕ: For example, for the set (a, a,b, c) the parameters аге n = 4, k = 3, 
nı = 2, nə = 1, and пз = 1. Hence, there are 0 - эт = 12 arrangements; 
they are 


аабс, aacb, абас, афса, acab, аса, 
баас, баса, bcaa, сааб, саба, cbaa. 


A derangement is a permutation of objects, in which object 4 is not in the i 
location. For example, all of the derangements of (1, 2, 3, 4] are 


2143, 2341, 2413, 
3142, 3412, 3421, 
4123, 4312, 4321. 


The number of derangements of n elements, D n, satis es the recursion relation, 
Dy = (n —1) (Dy 4 + Dn—z), with the initial values D; = 0 and D» = 1. Hence, 


px 1 1 
= n! ts = [ye 
Dy =n! (1- 177 БАЙРЫН. 1) 2) 


The numbers Г, are also called sub-factorials or rencontres numbers. For large 
values of n, Dn /n! ver! ~ 0.37. Hence more than one of every three permutations 
is a derangement. 


345 6 7 8 9 10 
EALE 2 9 44 265 1854 14833 133496 1334961 


3.3.6 PARTITIONS 


A partition of a number n is a representation of n as the sum of any number of 
positive integral parts. The number of partitions of n is denoted p(n). For example: 
5-4-1-3-2-9-1-1-2-2-1-2-1-1-1-і1-1-1-1-:1 
so that p(5) = 7. 


1. The number of partitions of n into exactly m parts is egual to the number 
of partitions of n into parts the largest of which is exactly m; this is denoted 
pa (n). For example, p2(5) = 2 and рз(5) = 2. Note агу), pm(n) = p(n). 


2. The number of partitions of n into at most m parts is equal to the number of 
partitions of n into parts which do not exceed m. 


© 2003 by CRC Press LLC 


The generating functions for p(n) is 


p(n) 1 2 3 5 7 11 15 22 30 42 

p(n) 56 77 101 135 176 231 297 385 490 627 
ШЫ 22 B3 . 25 % 27 28 2930 

p(n) | 792 1002 1255 1575 1958 2436 3010 3718 4565 5604 


3132 33 34 35 40 45 50 
pln) |6842 8349 10143 12310 14883 37338 89134 204226 


A table of pj, (n) values. 
The columns sum to p(n). 


7 
1 
3 
4 
3 
2 
1 
1 


— — M V л (л A =| оо 
— є— NIU л сыз 5-4 
к. — V чо л м1 моо олн 


3.3.7 BELL NUMBERS 


The п" Bell number, B,,, denotes the number of partitions of a set with n elements. 
Computationally, the Bell numbers may be written in terms of the Stirling subset 
numbers (page 213), Bn = Dm= А 


n| 23 4 5 10 10 
[Б„[1 2 5 15 52 203 877 4140 21147 115975 


1. A generating function for Bell numbers is У)? 9 Bunz” = exp (e* — 1) — 1. 
This gives Dobinski s formula: By, = е! У ym" /m!. 


2. For large values of n, By ~ noV/ŽIMn)]"+/2eM1)-1—1 where A(n) is de- 
ned by the relation: A(n) log A(n) = n. 


EXAMPLE There are B4 = 15 different ways to partition the 4 element set fa, b, с, d]: 


{a}, {c}, {8,4}, {a}, {4}, {b,c}, — (b {c}, ta d, {0b}, {d}, {a,c}, 
{c}, {d}, {a,b}, {a,b,c,d}, {a,b}, {c,d}, {a,c}, {b,d}, 
{а, d}, {b,c}, {a}, {0}, {c}, {d}, {a}, {b,c,d}, {b}, {a,c, d}, 
{c}, {a,b,d}, 4), {a,b,c}, {a}, {b}, fc, d}. 
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3.3.8 CATALAN NUMBERS 


1 2n —2 
The Catalan numbers are С„ = zc ( " 9 ) . There is the recurrence relation: 
n — n — 
Cn = СоСъ1 + CiCn—2 +... + Ch 469. (3.3.4) 
0 34 5 6 7 8 9 10 
| Ch | 1 2 5 14 42 132 429 1430 4862 


EXAMPLE Given the product A 42... An, һе number of ways to pair terms keeping 
the original order is Съ. For example, with n = 4, there are C4 = 5 ways to group the 
terms; they are (A; A2)(A3 44), ((A1 А») Аз) A4, (Ai (А» Аз)) Ал, A1((A2 Аз) А4), 
апа А1 (A2 (Аз.А4)). 


3.3.9 STIRLING CYCLE NUMBERS 


The number |] ‚ called a Stirling cycle number, is the number of permutations of n 
symbols which have exactly k non-empty cycles. 


EXAMPLE Ғог ће element set (a, b, c, d}, there are [$] = 11 permutations containing 
exactly 2 cycles. They are 


1234 1234 1234 

ЁОН Б (3124) = (823 (3241) 7! (1342), 
1234 1234 1234 
ж Q3) (2431) ^ (220 (2133) =| ОЛОХ 
1234 1234 1234 

( 34 ~ шар ( 42 Ж SA Ё 14 з) 54 2634, 
1234 1234 

3412 4321 


3.3.9.1 Properties of Stirling cycle numbers [7] 


1. b =Q- enc for k > 0. 


n] 1 ifn=0 У п 
Н n ifn £0 rem 


КЕС е PR 


—k 
| 1s a Stirling subset number. 
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z^ — (log(1 + z)) 
Э: Уч s(n, k) ті =>> — for |z| < 1. Here s(n, k) is a Stirling number 


of the r st kind and can be written as s(n, k) = (—1)"^*[7]. 


6. The factorial polynomial, de ned as r“) = x(a — 1)---(x — n +1) with 
x) = 1, can be written as 


a”) = > s(n,k)c* = s(n,1)x + s(n,2)z? +... +s(n,n)x" 3.3.5) 
k=0 


For example: 40) = z(z —1)(z—2) = 2r—3x?+1 = | | x — (ja? + ШЕ 


3.3.9.2 Table of Stirling cycle numbers [7] 


35 
225 
1624 
13132 
118124 
362880 | 1026576 | 1172700 | 723680 | 269325 | 63273 


оооооооооо 


1 
2 
3 
4 
5 
6 
7 
8 
9 
0 


- 


3.3.10 STIRLING SUBSET NUMBERS 


The Stirling subset number, 12) , is the number of ways to partition n into k blocks. 
Equivalently, it is the number of ways that n distinguishable balls can be placed into 
k indistinguishable cells, with no cell empty. 


EXAMPLE Placing the 4 distinguishable balls fa, b, c, d} into 2 indistinguishable cells, 
so that no cell is empty, can be done in ra = 7 ways. These are (vertical bars delineate 
the cells) 


[ab|cd|, |ad|bc|, |ac|bd|, |a]ļbcd], 
|b|acd|, |c|abd|, |d|abc|. 


3.3.10.1 Properties of Stirling subset numbers {7} 


1. Stirling subset numbers are also called Stirling numbers of the second kind, 
and are denoted by S(n, k). 


© 2003 by CRC Press LLC 


шэг. «та 

2 gu 
6. (9-3 554 por > 0 

{Ahab bov (8) nn 


8. Ordinary powers can be expanded in terms of factorial polynomials. Ifn > 0, 
then 


ox n Valk) — 2P Се) TE ET) n (a(n) 
т la ME НЕ ЖЕНЕ . (3.3.6) 


For example, 


ИКИ КИСИ 
" (515015 (8-1) ZH bole - D 23 837) 


=0+2+3(2? — x) + (a? — 32? + 2x). 


3.3.10.2 Table of Stirling subset numbers (7) 


10 1 

65 15 1 
350 140 21 1 
1701 1050 266 28 
7770 6951 2646 462 
34105 42525 22827 5880 
145750 246730 179487 63987 
611501 1379400 1323652 627396 
2532530 7508501 9321312 5715424 
10391745 | 40075035 | 63436373 | 49329280 
16383 | 2375101 | 42355950 | 210766920 | 420693273 | 408741333 


0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


i xL Lm i ы i ы i x 
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3.3.11 TABLES 
3.3.11.1 Permutations P(n,m) 


These tables contain the number of permutations of n distinct things taken m at a 


time, given by P(n,m) = = n(n —1):-:(n — m +1). 


120 

720 720 
2520 5040 5040 
6720 20160 40320 40320 
15120 60480 181440 362880 


30240 | 151200 604800 1814400 
55440 | 332640 1663200 6652800 
95040| 665280 | 3991680] 19958400 
154440 | 1235520 | 8648640] 51891840 
240240 | 2162160 | 17297280 | 121080960 


360360 | 3603600 | 32432400 | 259459200 


со 3 СС'л AUNE 
о NOU HWY RK 


© 
= 
© ж 


11 


— = = = 
шо мю є_ © 
ка к. 
шә N 


3628800 3628800 
19958400 39916800 39916800 
79833600 239500800 479001600 479001600 
259459200 | 1037836800 | 3113510400 6227020800 6227020800 
726485760 | 3632428800 | 14529715200 | 43589145600 | 87178291200 
1816214400 | 10897286400 | 54486432000 | 217945728000 | 653837184000 


3.3.11.2 Combinations C(n,m) = (2) 


These tables contains the number of combinations of n distinct things taken m at a 


time, given by С (п, т) = \„) = 
т 


22-28 o. | 
mo Epa paea e 
1 

3| 1 

6| 411 

10 | 10| 5| 1 
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: 
3 
4 
5 
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118755 
142506 
169911 
201376 
237336 
278256 
324632 


376992 
435897 
501942 
575757 
658008 


100947 
134596 
177100 


230230 
296010 
376740 
475020 
593775 
736281 
906192 
1107568 
1344904 
1623160 


1947792 
2324784 
276068 1 
3262623 
3838380 


116280 
170544 
245157 
346104 
480700 


657800 

888030 
1184040 
1560780 
2035800 
2629575 
3365856 
4272048 
5379616 
6724520 


8347680 
10295472 
12620256 
15380937 
18643560 


125970 167960 184756 167960 125970 
203490 293930 352716 352716 293930 
319770 497420 646646 105432 646646 


490314 817190 1144066 1352078 1352078 
735471 1307504 1961256 2496144 2704156 
1081575 2042975 3268760 4457400 5200300 
1562275 3124550 5311735 7726160 9657700 
2220075 4686825 8436285 13037895 17383860 


3108105 6906900 | 13123110 21474180 30421755 
4292145 10015005 | 20030010 34597290 51895935 
5852925 14307150 | 30045015 54627300 86493225 
7888725 | 20160075 | 44352165 84672315 | 141120525 
10518300 | 28048800 | 64512240 | 129024480 | 225792840 


13884156 | 38567100 | 92561040 | 193536720 | 354817320 
18156204 | 52451256 | 131128140 | 286097760 | 548354040 
23535820 | 70607460 | 183579396 | 417225900 | 834451800 


30260340 | 94143280 | 254186856 | 600805296 | 1251677700 
38608020 | 124403620 | 348330136 | 854992152 | 1852482996 


48903492 | 163011640 | 472733756 | 1203322288 | 2707475148 
61523748 | 211915132 | 635745396 | 1676056044 | 3910797436 
76904685 | 273438880 | 847660528 | 2311801440 | 5586853480 


153 18 

969 171 

4845 1140 

203490 116280 20349 5985 
497420 319770 170544 74613 26334 


1144066 817190 490314 245157 | 100947 
2496144 | 1961256 | 1307504 735471 | 346104 
5200300 | 4457400 | 3268760 | 2042975 | 1081575 
10400600 | 9657700 | 7726160 | 5311735 | 3124550 
27 | 20058300 | 20058300 | 17383860 | 13037895 | 8436285 
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37442160 
67863915 
119759850 
206253075 
347373600 


573166440 


927983760 
1476337800 
2310789600 
3562467300 


5414950296 
8122425444 
12033222880 


0176800 
77558760 
145422675 
265182525 
471435600 


818809200 
1391975640 
2319959400 
3796297200 
6107086800 


9669554100 
15084504396 
23206929840 


37442160 
77558760 
155117520 
300540195 
565722720 


1037158320 
1855967520 
3247943160 
5567902560 
9364199760 


15471286560 
25140840660 
40225345056 


30421755 
67863915 
145422675 
300540195 
601080390 


1166803110 
2203961430 
4059928950 
7307872110 
12875774670 


22239974430 
37711260990 
62852101650 


PES 
51895935 
119759850 
265182525 
565722720 


1166803110 
2333606220 
4537567650 
8597496600 
15905368710 


28781143380 
51021117810 
88732378800 


3.3.11.3 Fractional binomial coef cients (4) 


1/2 
1/3 
1/4 
1/5 
1/6 
1/7 
1/8 
1/9 
2/3 
2/5 
2/7 
2/9 
3/4 
3/5 
3/7 
3/8 
4/5 
4/7 
4/9 
5/6 
5/7 
5/8 
5/9 
6/7 
7/8 
7/9 
8/9 


Т 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
Т 
1 
1 
1 
1 
1 
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—1/8 
—1/9 
—3/32 
—2/25 
—5/72 
—3/49 
—7/128 
—4/81 
—1/9 
—3/25 
—5/49 
—7/81 
—3/32 
—3/25 
—6/49 
—15/128 
—2/25 
—6/49 
—10/81 
—5/72 
—5/49 
—15/128 
—10/81 
—3/49 
—7/128 
—7/81 
—4/81 


1/16 
5/81 
7/128 
6/125 


55/1296 

13/343 
35/1024 
68/2187 


4/81 
8/125 


20/343 
112/2187 


5/128 
7/125 


22/343 
65/1024 


4/125 


20/343 
140/2187 
35/1296 
15/343 


55/1024 
130/2187 


8/343 


21/1024 
77/2187 


40/2187 


—5/128 
—10/243 
—77/2048 
-21/625 
—935/31104 
— 65/2401 
—805/32768 
-442/19683 
—7/243 
—26/625 
—95/2401 
—700/19683 
-45/2048 
-21/625 
-99/2401 
-1365/32768 
-11/625 
—85/2401 
—805/19683 
—455/31104 
—60/2401 


—1045/32768 
—715/19683 

— 30/2401 
—357/32768 
—385/19683 


—190/19683 


7/256 
22/729 
231/8192 
399/15625 
4301/186624 


351/16807 
4991/262144 
3094/177147 

14/729 

468/15625 


494/16807 
4760/177147 
117/8192 
357/15625 
495/16807 


7917/262144 
176/15625 
408/16807 

5152/177147 

1729/186624 
276/16807 


5643/262144 
4433/177147 

132/16807 
1785/262144 
2233/177147 


1064/177147 


3.4 GRAPHS 


3.4.1 NOTATION 


3.4.1.1 Notation for graphs 


E edge set V vertex set 
С graph o incidence mapping 


3.4.1.2 Graph invariants 


Aut(G) automorphism group c(G) circumference 

d(u,v) distance between two vertices diam(G) diameter 

deg x degree of a vertex e(G) size 

есс(2) eccentricity gir(G) girth 

rad(G) radius Pa (x) chromatic polynomial 
Z(G) center a(G) independence number 
x(G) chromatic number x'(G) chromatic index 

ó(G) minimum degree A(G) maximum degree 
(С) genus 4(G) crosscap number 
к(С) vertex connectivity A(G) edge connectivity 
v(G) crossing number v(G) rectilinear crossing number 
0(G) thickness Y(G) arboricity 

u(G) cligue number (еі order 


3.4.1.3 Examples of graphs 


С, сусіе On odd graph 
Kn empty graph Р, раш 

Kn complete graph Qn cube 

Кът complete bipartite graph Sn star 

KY Kneser graphs Tk Turán graph 
М, Môbius ladder Wr wheel 


3.4.2 BASIC DEFINITIONS 


There are two standard de nitions of graphs, a general de nition and a more com- 
mon simpli cation. Except where otherwise indicated, this book uses the simpli ed 

de nition , according to which a graph is an ordered pair (V, Е) consisting of an ar- 
bitrary set V and a set E of 2-element subsets of V. Each element of V 1s called a 
vertex (plural vertices). Each element of E is called an edge. 
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According to the general de nition , a graph is an ordered triple С = (V, E, 6) 
consisting of arbitrary sets V and E and an incidence mapping © that assigns to each 
element e € E a non-empty set d(e) C V of cardinality at most two. Again, the 
elements of V are called vertices and the elements of E are called edges. А loop is 
an edge e for which |ó(e)| = 1. A graph has multiple edges if edges е 5 e' exist for 
which фФ(е) = ф(е'). 

A (general) graph is called simple if it has neither loops nor multiple edges. Be- 
cause each edge in a simple graph can be identi ed with the two-element set ф(е) С 
V, the simpli ed de nition of graph given above is just an alternative de nition of a 
simple graph. 

The word multigraph is used to discuss general graphs with multiple edges but 
no loops. Occasionally the word pseudograph is used to emphasize that the graphs 
under discussion may have both loops and multiple edges. Every graph G = (V, Е) 
considered here is nite , i.e., both V and E are nite sets. 

Specialized graph terms include the following: 


acyclic: A graph is acyclic if it has no cycles. 


adjacency: Two distinct vertices v and ш in a graph are adjacent if the pair {v, ш} 
is an edge. Two distinct edges are adjacent if their intersection is non-empty, 
1.e., if there is a vertex incident with both of them. 


adjacency matrix: For an ordering v1, v2,...,Un of the vertices of a graph С = 
(V, E) of order |G| = n, there is a corresponding n x n adjacency matrix A = 
(aij) de ned as follows: 


1 if {v;,0; E; 
15 | iE bove Es (3.4.1) 
0 otherwise. 


arboricity: The arboricity Y (G) of a graph G is the minimum number of edge- 
disjoint spanning forests into which G can be partitioned. 


automorphism: An automorphism of a graph is a permutation of its vertices that 
1s an isomorphism. 


automorphism group: The composition of two automorphisms is again an auto- 
morphism; with this binary operation, the automorphisms of a graph G form a 
group Aut(G) called the automorphism group of С. 


ball: The ball of radius k about a vertex u in a graph is the set 
B(u,k) = (v € V | d(u,v) € k}. (3.4.2) 
See also sphere and neighborhood. 


block: A block is a graph with no cut vertex. А block of a graph is a maximal 
subgraph that is a block. 
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boundary operator: The boundary operator for a graph is the linear mapping 
from 1-chains (elements of the edge space) to 0-chains (elements of the vertex 
space) that sends each edge to the indicator mapping the set of two vertices 
incident with it. See also vertex space and edge space. 


bridge: A bridge is an edge in a connected graph whose removal would disconnect 
the graph. 


cactus: A cactus is a connected graph, each of whose blocks is a cycle. 


cage: An (r,n)-cage is a graph of minimal order among r-regular graphs with 
girth n. A (3,n)-cage is also called an n-cage. 


center: The center Z(G) of a graph G = (V, E) consists of all vertices whose 
eccentricity equals the radius of G: 


Z(G) = (v € V(G) | ecc(v) = rad(G)}. (3.4.3) 
Each vertex in the center of G is called a central vertex. 


characteristic polynomial: АП adjacency matrices of a graph G have the same 
characteristic polynomial, which is called the characteristic polynomial of С. 


chromatic index: The chromatic index х' (С) is the least k for which there exists 
a proper k-coloring of the edges of С; in other words, it is the least number of 
matchings into which the edge set can be decomposed. 


chromatic number: The chromatic number х(С) of a graph G is the least k for 
which there exists a proper k-coloring of the vertices of G; in other words, it 
is the least k for which G is k-partite. See also multipartite. 


chromatic polynomial: For a graph G of order |G| = n with exactly k connected 
components, the chromatic polynomial of С is the unique polynomial Рс (x) 
for which Pg(m) is the number of proper colorings of С with m colors for 
each positive integer m. 


circuit: A circuit in a graph is a trail whose rst and last vertices are identical. 


circulant graph: A graph G is a circulant graph if its adjacency matrix is a circu- 
lant matrix; that is, the rows are circular shifts of one another. 


circumference: The circumference of a graph is the length of its longest cycle. 


clique: A clique is a set S of vertices for which the induced subgraph G[S] is 
complete. 


clique number: The clique number w(G) of a graph G is the largest cardinality of 
a clique in G. 


coboundary operator: The coboundary operator for a graph is the linear mapping 
from 0-chains (elements of the vertex space) to 1-chains (elements of the edge 
space) that sends each vertex to the indicator mapping of the set of edges 
incident with it. 
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cocycle vector: A cut vector is sometimes called a cocycle vector. 


coloring: A partition of the vertex set of a graph is called a coloring, and the 
blocks of the partition are called color classes. A coloring with Ё color classes 
is called a k-coloring. A coloring is proper if no two adjacent vertices belong 
to the same color class. See also chromatic number and chromatic polynomial. 


complement: The complement С of a graph G = (V, E) has vertex set V and 
edge set (22 V E; that is, its edges are exactly the pairs of vertices that are not 
edges of G. 


complete graph: A graph is complete if every pair of distinct vertices is an edge; 
К, denotes a complete graph with n vertices. 


component: A component of a graph is a maximal connected subgraph. 


connectedness: A graph is said to be connected if each pair of vertices is joined by 
a walk; otherwise, the graph is disconnected. A graph is k-connected if it has 
order at least k + 1 and each pair of vertices is joined by k pairwise internally 
disjoint paths. 


connectivity: The connectivity k(G) of G is the largest k for which С is k- 
connected. 


contraction: To contract an edge {v, w } of a graph G is to construct a new graph 
С! from С by removing the edge (v, w and identifying the vertices v and w. 
A graph G is contractible to a graph H if H can be obtained from G via the 
contraction of one or more edges of С. 


cover: A set S C V is a vertex cover if every edge of G is incident with some 
vertex in S. A set T C E is an edge cover of a graph С = (V, E) if each 
vertex of G is incident to at least one edge in Т. 


crosscap number: The crosscap number 5(G) of a graph С is the least g for which 
G has an embedding in a non-orientable surface obtained from the sphere by 
adding g crosscaps. See also genus. 


crossing: A crossing is a point lying in images of two edges of a drawing of a 
graph on а surface. 


crossing number: The crossing number v(G) of a graph G is the minimum num- 
ber of crossings among all drawings of G in the plane. The rectilinear cross- 
ing number v(G) of a graph G is the minimum number of crossings among all 
drawings of G in the plane for which the image of each edge is a straight line 
segment. 


cubic: A graph is a cubic graph if it is regular of degree 3. 


cut: For each partition V = У © 1 of the vertex set of a graph G = (V, E) into 
two disjoint blocks, the set of all edges joining a vertex in V, to a vertex in V2 
is called a cut. 
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cut space: The cut space of a graph G is the subspace of the edge space of G 
spanned by the cut vectors. 


cut vector: The cut vector corresponding to a cut С of a graph G = (V, E) is the 
mapping v: E > GF(2) in the edge space of G 


ecc 
mu , 3.4.4 
uke) F otherwise. ( ) 


cut vertex: A cut vertex of a connected graph is a vertex whose removal, along 
with all edges incident with it, leaves a disconnected graph. 


cycle: A cycle is a circuit, each pair of whose vertices other than the rst and the 
last are distinct. 


cycle space: The cycle space of a graph G is the subspace of the edge space of G 
consisting of all 1-chains with boundary 0. An indicator mapping of a set of 
edges with which each vertex is incident an even number of times is called a 
cycle vector. The cycle space is the span of the cycle vectors. 


degree: The degree deg x of a vertex x in a graph is the number of vertices adja- 
cent to it. The maximum and minimum degrees of vertices in a graph G are 
denoted A(G) and 6(G), respectively. 


degree sequence: A sequence (d1,...,d,,) is a degree sequence of a graph if there 
is some ordering v4, ..., v, of the vertices for which d; is the degree of v, for 
each 1. 


diameter: The diameter of G is the maximum distance between two vertices of G; 
thus it is also the maximum eccentricity of a vertex in G. 


digraph: A digraph is a directed graph; one in which each edge has a direction. 


distance: The distance d(u,v) between vertices u and v in a graph G is the mini- 
mum among the lengths of u, v-paths in G, or co if there is no u, v-path. 


drawing: А drawing of a graph G in a surface S consists of a one-to-one mapping 
from the vertices of G to points of S and a one-to-one mapping from the edges 
of G to open arcs in X so that (1) no image of an edge contains an image of 
some vertex, (ii) the image of each edge (v, w} joins the images of v and w, 
(iii) the images of adjacent edges are disjoint, (iv) the images of two distinct 
edges never have more than one point in common, and (v) no point of the 
surface lies in the images of more than two edges. 


eccentricity: Тһе eccentricity ecc(x) of a vertex x in a graph С is the maximum 
distance from z to a vertex of С. 


edge connectivity: The edge connectivity of G, denoted A(G), is the minimum 
number of edges whose removal results in a disconnected graph. 
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edge space: The edge space of a graph С = (V, E) is the vector space of all 
mappings from F to the two-element eld GF (2). Elements of the edge space 
are called 1-chains. 


embedding: An embedding of a graph G in a topological space X consists of an 
assignment of the vertices of G to distinct points of X and an assignment of 
the edges of G to disjoint open arcs in X so that no arc representing an edge 
contains some point representing a vertex and so that each arc representing an 
edge joins the points representing the vertices incident with the edge. See also 
drawing. 


end vertex: A vertex of degree 1 in a graph is called an end vertex. 


Eulerian circuits and trails: A trail or circuit that includes every edge of a graph 
is said to be Eulerian, and a graph is Eulerian if it has an Eulerian circuit. 


even: A graph is even if the degree of every vertex is even. 


factor of a graph: A factor of a graph G is a spanning subgraph of G. A factor in 
which every vertex has the same degree k is called a k-factor. If G1, Go, ..., 
Gi (k > 2) are edge-disjoint factors of the graph С, and if WES E(G;) = 
E(G), then С is said to be factored into G1, G2, ..., Ср and we write G = 
G4 OG Go Q-- ФС}. 


forest: A forest is an acyclic simple graph; see also tree. 


genus: The genus y(G) (plural form genera) of a graph G is the least g for which 
G has an embedding in an orientable surface of genus g. See also crosscap 
number. 


girth: The girth gir(G) of a graph G is the minimum length of a cycle in С, or oo 
if G is acyclic. 


Hamiltonian cycles and paths: A path or cycle through all the vertices of a graph 
is said to be Hamiltonian. A graph is Hamiltonian if it has a Hamiltonian 
cycle. 


homeomorphic graphs: Two graphs are homeomorphic to one another if there is 
a third graph of which each is a subdivision. 


identification of vertices: To identify vertices v and w of a graph G is to construct 
a new graph G" from G by removing the vertices v and w and all the edges 
of G incident with them and introducing a new vertex u and new edges joining 
u to each vertex that was adjacent to v or to ш in G. See also contraction. 


incidence: A vertex v and an edge e are incident with one another if v € e. 


incidence matrix: For an ordering v1,v»,..., Un of the vertices and an ordering 
€1, €2,... , €m Of the edges of a graph С = (V, E) with order |G| = n and 
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FIGURE 3.2 


Three graphs that are isomorphic. 


ша 


size e(G) = m, there is a corresponding n x m incidence matrix В = (bij) 
de ne d as follows: 


1, ifv; ande; are incident, 


bi; = 3.4.5 
? n otherwise. ( ) 


independence number: The independence number a(G) of a graph G = (V, E) 
is the largest cardinality of an independent subset of V. 


independent set: A set S C V is said to be independent if the induced sub- 
graph G[S] is empty. See also matching. 


internally disjoint paths: Two paths in a graph with the same initial vertex v 
and terminal vertex w are internally disjoint if they have no internal vertex in 
common. 


isolated vertex: A vertex is isolated if it is adjacent to no other vertex. 


isomorphism: An isomorphism between the two graphs G = (Va, Ёс) and H = 
(Үн, Ен) is a bijective mapping v: Ус — Vy for which {x,y} € Eg if and 
only if ((x),v(y)) € Ен. If there is an isomorphism between С апа H, 
then G and H are said to be isomorphic to one another; this is denoted as 
G = Н. Figure 3.2 contains three graphs that are isomorphic. 


labeled graph: Graph theorists sometimes speak loosely of labeled graphs of 
order n and unlabeled graphs of order n to distinguish between graphs with 
a x ed vertex set of cardinality n and the family of isomorphism classes of 
such graphs. Thus, one may refer to labeled graphs to indicate an intention to 
distinguish between any two graphs that are distinct (1.е., have different vertex 
sets and/or different edge sets). One may refer to unlabeled graphs to indicate 
the intention to view any two distinct but isomorphic graphs as the “same" 
graph, and to distinguish only between non-isomorphic graphs. 


matching: А matching in a graph is a set of edges, no two having a vertex in 
common. À maximal matching is a matching that is not a proper subset of any 
other matching. A maximum matching is a matching of greatest cardinality. 
For a matching M, an M-alternating path is a path whose every other edge 
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belongs to M, and an M-augmenting path is an M-alternating path whose rst 
and last edges do not belong to M. A matching saturates a vertex if the vertex 
belongs to some edge of the matching. 


monotone graph property: A property P that a graph may or may not enjoy is 
said to be monotone if, whenever Н is a graph enjoying 7, every supergraph G 
of H with |G| = |Н| also enjoys Р. 


multipartite graph: A graph is k-partite if its vertex set can be partitioned into k 
disjoint sets called color classes in such a way that every edge joins vertices 
in two different color classes (see also coloring). A two-partite graph is called 
bipartite. 


neighbor: Adjacent vertices v and w in a graph are said to be neighbors of one 
another. 


neighborhood: Тһе sphere 5(т, 1) is called the neighborhood of т, and the 
Бай B(z, 1) is called the closed neighborhood of т. 


order: The order |G| of a graph G = (V, E) is the number of vertices in G; in 
other words, |G| = [V |. 


path: A path is a walk whose vertices are distinct. 


perfect graph: A graph is perfect if y(H) = «(Н) for all induced subgraphs H 
of G. 


planarity: A graph is planar if it has a proper embedding in the plane. 
radius: The radius rad(G) of a graph G is the minimum vertex eccentricity in G. 


regularity: A graph is k-regular if each of its vertices has degree k. A graph is 
strongly regular with parameters (k, A, u) if (i) it is k-regular, (ii) every pair of 
adjacent vertices has exactly А common neighbors, and (iii) every pair of non- 
adjacent vertices has exactly и common neighbors. A graph G = (V, E) of 
order |G| > 3 is called highly regular if there exists an n x n matrix C = (с;;), 
where 2 < n < |G|, called a collapsed adjacency matrix, so that, for each 
vertex v of G, there is a partition of V into n subsets V; = {v}, Vo, ..., Vn so 
that every vertex y € V; is adjacent to exactly c;; vertices in V;. Every highly 
regular graph is regular. 


rooted graph: A rooted graph is an ordered pair (С, v) consisting of a graph С 
and a distinguished vertex v of G called the root. 


self-complementary: A graph is self-complementary if it is isomorphic to its com- 
plement. 


similarity: Two vertices u and v of a graph G are similar (in symbols u ~ v) if 
there is an automorphism a of G for which a(u) — v. Similarly, two edges 
(u, v) and (a, b) in the graph С are similar if an automorphism a of С exists 
for which {a(u), a(v)) = {a,b}. 
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size: The size e(G) of a graph G — (V, E) is the number of edges of G, that is, 
e(G) = |E]. 


spectrum: The spectrum of a graph G is the spectrum of its characteristic polyno- 
тілі, i.e., the non-decreasing sequence of |С | eigenvalues of the characteristic 
polynomial of G. Since adjacency matrices are real symmetric, their spectrum 
is real. 


sphere: The sphere of radius Ё about a vertex и is the set 
S(u,k) = (v € V | d(u,v) = k}. (3.4.6) 
See also ball and neighborhood. 


subdivision: To subdivide an edge (v, w} of a graph G is to construct a new graph 
С! from С by removing the edge (v, w} and introducing new vertices x ; and 
new edges (v, 21], (x4, w} and (zi, ж; 1} for 1 € i < k. A subdivision of a 
graph is a graph obtained by subdividing one or more edges of the graph. 


subgraph: A graph H = (Үн, Eg) is a subgraph of a graph С = (Ус, Ес) (іп 
symbols, H < G), if Vy C Vg and Ен С Eg. In that case, G is a supergraph 
of H (in symbols, С > H). If Vi; = Үс, then Н is called a spanning subgraph 
of G. For each set S C Vg, the subgraph G[S] of G induced by S is the unique 
subgraph of G with vertex set S for which every edge of G incident with two 
vertices іп S is also ап edge of G[S]. 


symmetry: A graph is vertex symmetric if every pair of vertices is similar. A graph 
is edge symmetric if every pair of edges is similar. A graph is symmetric if it 
is both vertex and edge symmetric. 


2-switch: For vertices v,wW,x,y in a graph С for which (v, w} and {х,у} are 
edges, but (v, y} and (x, w} are not edges, the construction of a new graph G" 
from G via the removal of edges (v, w} and (x, y) together with the insertion 
of the edges (v, y) and (x, w} is called a 2-switch. 


thickness: The thickness 0(G) of a graph G is the least k for which G is a union 
of k planar graphs. 


trail: A trail in a graph is a walk whose edges are distinct. 


tree: A free is a connected forest, i.e., a connected acyclic graph. A spanning 
subgraph of a graph G that is a tree is called a spanning tree of С. 


triangle: A 3-cycle is called a triangle. 
trivial graph: A trivial graph is a graph with exactly one vertex and no edges. 


unicyclic graph: А unicyclic graph is a connected graph that contains exactly one 
cycle. 


vertex space: The vertex space of a graph G is the vector space of all mappings 
from V to the two-element eld G.F(2). The elements of the vertex space are 
called 0-chains. 
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walk: А walk in a graph is an alternating sequence vo, e1,U1,. .., ex, Uy Of ver- 
tices v, and edges е; for which ej is incident with v;_; and with v, for each 4. 
Such a walk is said to have length k and to join vg and v,. The vertices vo 
and v; are called the initial vertex and terminal vertex of the walk; the remain- 
ing vertices are called internal vertices of the walk. 


3.4.3 CONSTRUCTIONS 


3.4.3.1 Operations on graphs 

For graphs Сі = (Vi, E1) and С» = (72, E2), there are several binary operations 
that yield a new graph from G and G2. The following table gives the names of some 
of those operations and the orders and sizes of the resulting graphs. 


Operation producing G | Order |G Size e(G) 
Composition Gi[G»] | [Gi]: |< [Gi |e(G3) + |G2|?e(G1) 
Conjunction Gi A G» | |Gi|- |G» 


Edge sum“ | G1 G^» | |Gi| = |С»| | € (e(Gi) + e(G3)) 

Join G4 T Go IG, | + |62| e(G1) + е(Сә) + IG | 5 |62| 
Product Сі x G5 [е . [Ga [Gi le(G>) + [Ga le(G1) 
Union G1 U G2 | |Gi|+|Ge| | е(Сі) + e(G2) 


“When applicable. 


composition: For graphs С = (Vi, Е) and Сә = (V5, E»), the composition 
С = Gi[G>] is the graph with vertex set V, x V5 whose edges are (1) the pairs 
fu, v), (u, w)} with u € У and (v, w} € E» and (2) the pairs {(t, и), (v, w)} 
for which (t,v) € А. 


conjunction: The conjunction G A G of two graphs Сү = (Vi, E1) and G2 = 
(V2, Ез) is the graph Сз = (V3, Ез) for which V: = V, x V2 and for which 
vertices е = (u1, u2) and e2 = (v1, v») in Vz are adjacent in Сз if, and only 
if, u is adjacent to v in G1 and цэ is adjacent to v» in С. 


edge difference: For graphs G1 = (V, E4) and С» = (V, E2) with the same vertex 
set V, the edge difference Су — G is the graph with vertex set V and edge set 
E \ Es. 


edge sum: For graphs Сү = (V, Е) and С» = (V, Е) with the same vertex 
set V, the edge sum of Су and С» is the graph С © G^» with vertex set V and 
edge set Ej U E». Sometimes the edge sum is denoted (71 U G2. 


join: For graphs С = (Vi, Ё) and С = (Vo, Ey) with V; ПУ; = 0, the join 
G1 + G2 = G2 + С is the graph obtained from the union of С у and (72 by 
adding edges joining each vertex іп V, to each vertex in V2. 


power: For a graph G = (V, E), the k“ power G^ is the graph with the same 
vertex set V whose edges are the pairs fu, v] for which d(u,v) € k in G. The 
square of G 18 G?. 
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product: For graphs С = (Vi, Е) and Gə = (Vo, Ез), the product G1 x Ga has 
vertex set Уу x V5; its edges are all of the pairs f(u, v), (u, w)+ for which u € 
V, and {v,w} € Ез and all of the pairs f(t, v), (u, v)+ for which (t, u} € Fy 
and v € Va. 


union: For graphs С = (Vi, Ё) and С» = (Va, E2) with V; N Vo = 0, the 
union of G4 and Со is the graph Gi U С» = (Vi U Vo, Е U Ез). The union 
is sometimes called the disjoint union to distinguish it from the edge sum. 


3.4.3.2 Graphs described by one parameter 


complete graph, К,: A complete graph of order n is a graph isomorphic to the 
graph Ку, with vertex set {1,2,...,} whose every pair of vertices is an edge. 
The graph К,, has size (5) and is Hamiltonian. If G is a graph g of order n, 
then К, =GOG. 


cube, Qn: Ап n-cube is a graph isomorphic to the graph Q , whose vertices are 
the 2” binary n-vectors and whose edges are the pairs of vectors that differ in 
exactly one place. It is an n-regular bipartite graph of order 2” and size п27-1, 
An equivalent recursive de nition , Q1 = Kə and Qn = О,-і X Кә. 


cycle, Cn: A cycle of order n is a graph isomorphic to the graph С,, with vertex 
set (0, 1,..., n — 1} whose edges are the pairs (0,0: 1 } with 0 < 4 < n and 
arithmetic modulo n. The cycle С; has size n and is Hamiltonian. 
The graph С; is a special case of a circulant graph. The graph C 4 is called а 
triangle; the graph Са is called a square. 


empty graph: A graph is empty if it has no edges; K „ denotes an empty graph of 
order n. 


Kneser graphs, KY“: For n > 2m, the Kneser graph KẸ™ 18 the complement 
of the intersection graph of the m-subsets of ап n-set. The odd graph O m is 
the Kneser graph К an The Petersen graph is the odd graph О» = K (29) 

ladder: A ladder is a graph of the form P, х Р». The Möbius ladder Mn» is the 
graph obtained from the ladder P,, x Р» by joining the opposite end vertices 
of the two copies of P. 


path, Р,: A path of order n is a graph isomorphic to the graph Р, whose vertex 
set is {1,...,n} and whose edges are the pairs (vi, vi+1 + with 1 < i < n. A 
path of order n has size n — 1 and is a tree. 


star, 5,: A star of order n is a graph isomorphic to the graph 5, = Кү. It has 
a vertex cover consisting of a single vertex, its size is n, and it is a complete 
bipartite graph and a tree. 


wheel, W,: Тһе wheel W, of order n > 4 consists of a cycle of ordern — 1 
and an additional vertex adjacent to every vertex in the cycle. Equivalently, 
Wn = C41 + Ki. This graph has size 2(n — 1). 
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3.4.3.3 Graphs described by two parameters 
complete bipartite graph, Kn,m: The complete bipartite graph Kn,m is the 
graph Kn + Km. Its vertex set can be partitioned into two color classes of 
cardinalities n and m, respectively, so that each vertex in one color class is ad- 
jacent to every vertex in the other color class. The graph K n,m has ordern-+m 
and size nm. 


planar mesh: A graph of the form Р,, x Pm is called a planar mesh. 
prism: A graph of the form C'm х Р, is called a prism. 


Toeplitz graph, TN(w, s): The Toeplitz graph TN(w, s) is de ned in terms of its 
adjacency matrix А = (а;;), for which 


т = Ед dw), 
ас ЫЕ ey) (3.4.7) 
0, otherwise. 

The Toeplitz graph is of order ws + 2, size (s + 1)(w — s + 2)/2, and girth 3 
or 4; it is (s + 1)-regular and Hamiltonian. Moreover, TN(1, s) = K ,42 and 
TN(w, 1) = Cua. 


toroidal mesh: A graph of the form С, x С, with m > 2 and n > 2 is called a 
toroidal mesh. 


Turan graph, Т, ,: Тһе Turán graph T, is the complete k-partite graph іп 
which the cardinalities of any two color classes differ by, at most, one. It has 
n — k [n/k| color classes of cardinality |n/k| + 1 and k — n + k |n/k] color 
classes of cardinality |n/k]. Note that (T, р) = k. 


3.4.3.4 Graphs described by three or more parameters 
Cayley graph: For a group Г and a set X of generators of Г, the Cayley graph 
of the pair (T, X) is the graph with vertex set Г in which fa, 8] is an edge if 
either a7! 8 € X or 87ta € X. 


complete multipartite graph, Kn, n>,...nk? The complete k-partite graph 
Korne... ny 18 the graph Kn, +++ + Kn,- Itis a a k-partite graph with color 
classes V, of cardinalities |V;| = n; for which every pair of vertices in two 


distinct color classes is an edge. The graph K,,,,,,,...,,,, has order bem Nk 
and size 5 1 «у ninj. 


double loop graph, DLG (n;a, b): The double loop graph DLG (n; a,b) (with a 
and b between 1 and (n — 1)/2) consists of n vertices with every vertex i con- 
nected by an edge to the vertices i + a and i + b (modulo n). The name comes 
from the following fact: If GCD(a,b,n) — 1, then DLG(n: a,b) is Hamilto- 
nian and, additionally, DLG(n: a, b) can be decomposed into two Hamiltonian 
cycles. These graphs are also known as circulant graphs. 
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FIGURE 3.3 
Examples of graphs with 6 or 7 vertices. 


° 
e e 
Ke = P; = 
e e 
e 
Св = K3 3 Ж 


intersection graph: For a family F = {S1,..., Sn} of subsets of а set S, the 
intersection graph of Е is the graph with vertex set F in which (S,, S, } is an 
edge if and only if S, 15; Z 0. Each graph С is an intersection graph of some 
family of subsets of a set of cardinality at most ||G|? /4 |. 


interval graph: An interval graph is an intersection graph of a family of intervals 
on the real line. 


3.4.4 FUNDAMENTAL RESULTS 


3.4.4.4 Walks and connectivity 
1. Every x,y walk includes all the edges of some x,y path. 


2. Some path in С has length ó(G). 


3. Connectivity is a monotone graph property. If more edges are added to a 
connected graph, the new graph is itself connected. 


4. A graph is disconnected if, and only if, it is the union of two graphs. 


5. The sets S for which G[S] is a component partition of the vertex set V. 
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10. 


11. 


. Every vertex of a graph lies in at least one block. 
. For every graph G, 0 € &(G) < |G| — 1. 


. For all integers a, b, c with 0 < a < b € c, a graph С exists with x(G) = a, 


Ха) = b, and 6(G) = c. 


. For any graph G, к(С) € MG) < ó(G). 


Menger's theorem: Suppose that G is a connected graph of order greater 
than k. Then G is k-connected if, and only if, it is impossible to disconnect G 
by removing fewer than Ё vertices, and G is k-edge connected if, and only if, 
it is impossible to disconnect G by removing fewer than k edges. 


If G is a connected graph with a bridge, then A(G) = 1. If G has order n and 
is r-regular with r > n/2, then A(G) — r. 


3.4.4.2 Trees 


1. 
2. 
3. 


10. 


11. 


A graph is a tree if, and only if, it is acyclic and has size |G| — 1. 
A graph is a tree if, and only if, it is connected and has size |G| — 1. 


A graph is a tree if, and only if, each of its edges is a bridge. 


. A graph is a tree if, and only if, each vertex of degree greater than 1 is a cut 


vertex. 


. A graph is a tree if, and only if, each pair of its vertices is joined by exactly 


one path. 


. Every tree of order greater than 1 has at least two end vertices. 
. The center of a tree consists of one vertex or two adjacent vertices. 
. For each graph С, every tree with at most (С) edges is a subgraph of С. 


. Every connected graph has a spanning tree. 


Kirchhoff matrix-tree theorem: Let G be a connected graph and let A be an ad- 
jacency matrix for С. Obtain a matrix M from — A by replacing each term a ;; 
on the main diagonal with degv;. Then all cofactors of M have the same 
value, which is the number of spanning trees of G. 


Nash-Williams arboricity theorem: For a graph G and for each n < |G], de ne 
en(G) = maxfe(H) : H < G, and |H| = n) . Then 


Y(G) = шах | 


n 


| ! (3.4.8) 


n—1 
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3.4.4.3 Circuits and cycles 


1. Euler’s theorem: A multigraph is Eulerian if and only if it is connected and 
even. 


2. If G is Hamiltonian, and if G" is obtained from G by removing a non-empty 
set S of vertices, then the number of components of G’ is at most |$]. 


3. Ore’s theorem: If G is a graph for which deg v + degw > |G| whenever v 
and ш аге non-adjacent vertices, then G is Hamiltonian. 


4. Dirac’s theorem: If G is a graph of order |G| > З and deg v > |G|/2 for each 
vertex v, then G is Hamiltonian. 


5. (Erdós-Chvátal) If a(G) < «(G), then G is Hamiltonian. 
6. Every 4-connected planar graph is Hamiltonian. 


7. The following table tells which members of several families of graphs are 
Eulerian or Hamiltonian: 


yes yes, forn > 1 
yes yes, forn > 1 
yes, for n even yes, for n > 2 


yes, for odd n yes, form > 3 
yes, for m and n both even | yes, form — n 
yes, for n even yes, for n > 2 
no yes, for n > 2 


3.4.4.4 Cliques and independent sets 
1. A set S CV is a vertex cover if, and only if, V V S is an independent set. 


2. Turán's theorem: If |G| = n and w(G) < k, then e(G) < AT, k). 


3. Ramsey’s theorem: For all positive integers k and l, there is a least inte- 
ger R(k, 1) for which every graph of order at least R(k, 1) has either a clique 
of cardinality k or an independent set of cardinality |. For k > 2 and l > 2, 
R(k,l) € R(k,l — 1) + R(k — 1,1). 


PRED | шр ee ЖА 


1 11111 
2 1:12 
3 1 | 3 С is 2 


© 2003 Бу СЕС Press LLC 


3.4.4.5 Colorings and partitions 


1. 


11. 


Every graph G is k-partite for some k; in particular, G is |G|-partite. 


2. Every graph G has a bipartite subgraph H for which e(H) > e(G)/2. 
3. 
4 


Pa(x) = Pa el) — Pane(z). 


. Brooks’ theorem: If G is a connected graph that is neither a complete graph 


nor a cycle of odd length, then x(G) < A(G). 


. For all positive integers g and c, a graph G exists with x(G) > cand gir(G) > 


g. 


. Nordhaus-Gaddum bounds: For every graph G, 


2y|G| < x(G) + x(G) € |G| +1, and 


cs «eye < (EL) . 


. Szekeres—Wilf theorem: For every graph G = (V, E), 


x(G) < 1+ max é(GIS]). 


. (König) If G is bipartite, then x (G) = A(G). 
. Vizing's theorem: For every graph С, AMG) < x'(G) < A(G) +1. 
10. 


The following table gives the chromatic numbers and chromatic polynomials 
of various graphs: 


The following table gives the chromatic numbers and edge-chromatic numbers 
of various graphs: 


С, with n even, n > 2 
С, with n odd, n > 3 
К, with n even, n > 2 
Ky with n odd, n > З 
Къп with m,n > 1 
Km... m, With m; > 1 
Р, 

Petersen graph 

Wn with n even, n > 2 
Wn with n odd, n > 3 


2 
3 
n 
n 
2 
k 
2 
3 
3 
4 
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12. (Appel-Haken) Four-color theorem: x(G) < 4 for every planar graph С. 


13. For each graph G of order |G| = n and size e(G) = m with exactly k compo- 
nents, the chromatic polynomial is of the form 


n—k 
Pa(z) = X (-1)'aia" 5, (3.4.9) 


with ag = 1, a, = m and every a, positive. 


14. Not every polynomial is a chromatic polynomial. For example P(x) = x“ — 
Az? + 3x? is not a chromatic polynomial. 


15. Sometimes a class of chromatic polynomials can only come from a speci c 
class of graphs. For example: 


(a) If Pg(x) = x”, then G = Ky. 

(b) If Pa (x) = (#)n, then G = Ky. 

(c) If Pa (x) = z(z—1):- (2-7 +2) (2-71) 2 (z—r)"77^! fora graph 
of order n > r + 1, then G can be obtained from an r-tree T of order n 
by deleting an edge contained in exactly r — 1 triangles of Т. 


3.4.4.6 Distance 


1. A metric space (X,d) is the metric space associated with a connected graph 
with vertex set X if, and only if, itsatis es two conditions: (i) d(u, v) is a non- 
negative integer for all u, v € X, and (ii) whenever d(u, v) > 2, some element 
of X lies between u and v. The edges of the graph are the pairs {u,v} C X 
for which d(u, v) = 1. (In an arbitrary metric space (X, d), a point v € X is 
said to lie between distinct points u € X and w € X ifitsatises the triangle 
equality d(u,w) = d(u,v) + d(v, w).) 


2. If G = (V, E) is connected, then distance is always nite, and d is a metric 
on V. Note that deg(z) = |.S(a, 1)]. 


3. Moore bound: For every connected graph G, 


diam(G) 
IG| «1- A(G) M. (A(G) - 1. (3.4.10) 


1-1 


A graph for which the Moore bound holds exactly is called a Moore graph 
with parameters (|G|, A (G), diam(G)). Every Moore graph is regular. If G 
is a Moore graph with parameters (n, r, d), then (n,r,d) = (n,n — 1,1) (іп 
which case С is complete), (n, r, d) = (2m + 1, 2, m) (in which case С is a 
(2m + 1)-cycle), or (n, т, d) € {(10, 3,2), (50, 7, 2), (3250, 57, 2)}. 
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3.4.4.7 Drawings, embeddings, planarity, and thickness 


1. 


11. 


12. 


Every graph has an embedding in R? for which the arcs representing edges 
are all straight line segments. Such an embedding can be constructed by using 
distinct points on the curve {(t, t?, t?) : 0 < t < 1} as representatives for the 
vertices. 


. Forn > 2, 
19) = (п – ae +1, and 3411) 
5(О0һ) = (n — 42"? + 2. 
. Forr,s > 2, 
ÚK, s) = Б - 2 — 2| , and 
(3.4.12) 
ТҮЙЕСІН 
. Forn > 3, 
s; - ja 
sajú (3.4.13) 


sa) - [28224] 


. Heawood map coloring theorem: The greatest chromatic number among graphs 


of genus n is 


max{x(G) | (6) =n} = | >) 


. Kuratowski’s theorem: A graph is planar if and only if it has no subgraph 


homeomorphic to K5 or Кзз. 


. A graph is planar if and only if it does not have a subgraph contractible to K 5 


or Кз 3. 


. The graph Kn is non-planar if and only ifn > 5. 


. Every planar graph can be embedded in the plane so that every edge is a 


straight line segment; this is a Fary embedding. 


. The four-color theorem states that any planar graph is four colorable. 


For every graph С of order |G| > 3, 0(G) > ЕСЕ 1 | 


The complete graphs Ко and Ко have thickness 3; for n £ {9, 10}, 
n+7 
e 


6(K,) = | (3.4.14) 
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13. 
14. 


The n-cube has thickness 0(Q4) = [n/4] + 1. 


For every planar graph С, (С) = 7(G). That equality does not hold for ай 
graphs: v( Kg) = 18, and V( Ks) = 19 


3.4.4.8 Vertex degrees 


1. 
2. 
3. 


4. 


Handshaking lemma: For every graph G, сү deg = 2e(G). 
Every 2-switch preserves the degree sequence. 


If G and H have the same degree sequence, then H can be obtained from G 
via a sequence of 2-switches. 


Havel theorem: The values (d1,d5,...,d4,] with di > d2 2--24 > 0 
аге a degree sequence if and only if the sequence obtained by deleting 41 and 
subtracting 1 from each of the next d; largest values (i.e., {d2 — 1, da —1,..., 
da,+1 — 1, da,+42,..., dn +) is a degree sequence. 


3.4.4.9 Algebraic methods 


1. 
2: 


The bipartite graphs K, аге circulant graphs. 


For a graph G with exactly & connected components, the cycle space has di- 
mension e(G) — |G| + k, and the cut space has dimension |G| — k. 


. In the k“ power А“ = (a*.) of the adjacency matrix, each entry аў, is the 


aj 
number of v,, 9; walks of length k. 


. The incidence matrix of a graph G is totally unimodular if, and only if, G is 


bipartite. 


. Every odd graph is vertex-transitive. 


. The smallest graph that is vertex symmetric, but is not edge symmetric, is the 


prism Кз х А5. The smallest graph that is edge symmetric, but is not vertex 
symmetric, is $5 = P3 = Кү. 


. The spectrum of a disconnected graph is the union of the spectra of its compo- 


nents. 


. The sum of the eigenvalues in the spectrum of a graph is zero. 


. The number of distinct eigenvalues in the spectrum of a connected graph is 


greater than the diameter of the graph. 


. The largest eigenvalue in the spectrum of a graph G is, at most, A(G), with 


equality if, and only if, G is regular. 
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11. 


12. 


13. 


14. 


15. 
16. 


17. 


18. 


(Wilf) If G is a connected graph and its largest eigenvalue is A, then x(G) < 
1 + А. Moreover, equality holds if, and only if, С is a complete graph or a 
cycle of odd length. 


(Hoffman) If С is a connected graph of order n with spectrum A 1 >... > An, 
then x(G) > 1— А/А. 


Integrality condition: ТЁ G is a strongly regular graph with parameters (k, A, и), 
then the quantities 


1 —1)(1 — A) —2 

-1(0|-14 (G| = Dt» =A) -2k (3.4.15) 
2 (и — A)? + Ak — и) 

are non-negative integers. 


The following table gives the automorphism groups of various graphs: 


A graph and its complement have the same group, Aut(G) = Aut(G). 


Frucht’s theorem: Every nite group is the automorphism group of some 
graph. 


If G and С' are edge isomorphic, then G and С' are not necessarily required 
to be isomorphic. For example, the graphs Сз and S3 are edge isomorphic, but 
not isomorphic. 


If the graph G has order n, then the order of its automorphism group |Aut(G)| 
is a divisor of n!. The order of the automorphism group equals n! if and only 
ifG o K,orG = Ky. 


3.4.4.10 Matchings 


1. 


A matching M is a maximum matching if, and only if, there is no M-augmenting 
path. 


2. Hall's theorem: A bipartite graph С with bipartition (B1, B») has a matching 


that saturates every vertex in Bı if, and only if, |S(A,1)| > |A| for every 
АСВ). 


3. Kónig's theorem: In a bipartite graph, the cardinality of a maximum matching 


equals the cardinality of a minimum vertex cover. 
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3.4.4.11 Enumeration 


1. 


2: 
3. 


The number of labeled graphs of order n is 2 (9. 


The number of labeled graphs of order n and size m is (6) я 


The number of different ways in which а graph С of order п can be labeled is 
n!/ |Aut(G)]. 


. Cayley's formula: The number of labeled trees of order n 18 n ^2. 


. The number of labeled trees of order n with exactly t end vertices is 


2 S(n — 2,n — t) for 2 € t < n — 1 (where S(,) is a Stirling number of the 


second kind). 


. The following table lists the number of graphs, number of digraphs, number 


of trees (tn), number of rooted trees (Tn), of different orders. 


Order Graphs Digraphs Trees (tn) Rooted trees (Т) 
1 
3 
16 
11 218 
34 9608 


156 1540944 
1044 682033440 
12346 1793359192848 
274668 
12005168 


. De пе the generating functions T (£) = УТ" and t(x) = У)? 9 tnx”. 


Then T(x) = техр (У) , 27 (x")) „andt (x) = Т(а)-5 [T?(x) — T (?)]. 


т=1 r 


. The following table lists the number of isomorphism classes of graphs of or- 


der n and size m. 


1 
2 
3 
4 
5 
6 
7 
8 
9 
0 


к- 


663 1637 
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re 50 zs 
1312 5995 
97 1557 10120 


65 1646 15615 


41 1557 21933 


2] 1312 27987 
10 980 32403 
5 34040 


9. The following table lists the number of isomorphism classes of digraphs with 
n vertices and m arcs. 


220 
495 
792 15,504 
924 38,760 
792 77,520 


10. Тһе following table gives the number of labeled graphs of order n having 
various properties: 


п |1]2]3]4| 5: 6) 7) 8 


АП 8 | 64 221 228 
Connected 4 | 38 1 866256 | 251 548 592 
Even 2| 8 215 221 
Trees 3116 16 807 262 144 


11. The following table gives the numbers of isomorphism classes of graphs of 
order n exhibiting various properties: 


sja 
Even 


Eulerian 
Blocks 
Trees 
Rooted trees 
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3.4.4.12 Descriptions of graphs with few vertices 


The small graphs can be described in terms of the operations on page 228. Let G n,m 
denote the family of isomorphism classes of graphs of order n and size m. Then 


Gio = {Ki}, Gao = {Ка}, 

Goo = {Ko}, бал = {P2U Ko}, 

G21 = {K2}, 9,2 = {P3 U Ki, P2 U Po}, 
G3,0 = {Кз}, баз = (P4, KaU Ki, Ki 3}, 
G31 = (K3U Kı}, бла = (C4, (K2 U K1) + Kı}, 
G32 = (P3), блв = (K4— e}, 

G3,3 = {Кз}, бав = {Ka} 


3.4.5 TREE DIAGRAMS 


Let Tn,m denote the m isomorphism class of trees of order n. Figure 3.4 (page 
242) depicts trees of order at most 7. Figure 3.5 (page 243) depicts trees of order 8. 


3.5 COMBINATORIAL DESIGN THEORY 


Combinatorial design theory is the study of families of subsets with various pre- 
scribed regularity properties. An incidence structure is an ordered pair (X, B): 


1. X = (z1,..., £y } is a set of points. 

2. В = {By,..., By} is a set of blocks or lines, each B; С X. 

3. The replication number r; of x; is the number of blocks that contain x ;. 
4. The size of В; is k. 


Counting the number of pairs (x, B) with x € B yields 37; ут; = RE k;. The 
incidence matrix of an incidence structure is the v x b matrix А = (a) with а; = 1 
if x; € Bj and 0 otherwise. 


3.5.4 t-DESIGNS 
The incidence structure (X, B) is called a t-(v, k, A) design if 


1. Forall j,k; = k and 1 < k < v, and 
2. Any subset of £ points is contained in exactly A blocks. 


© 2003 by СКС Press LLC 


FIGURE 3.4 


Trees with 7 or fewer vertices. 
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FIGURE 3.5 


Trees with 8 vertices. 
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A 1-design is equivalent to a v х b 0-1 matrix with constant row and column 
sums. Every t-(v, k, A) design is also a (-(v, k, Ax) design (1 < £ < t), where 


v—£ k=l 
БЭ (0, аз 


A necessary condition for the existence of a t-(v, k, A) design is that A, must be an 
integer for all £, 1 < £ < t. Another necessary condition is the generalized Fisher's 
inequality: if t = 2s, then b > (7). 


3.5.1.1 Related designs 


The existence of a t-(v, k, A) design also implies the existence of the following de- 
signs: 
Complementary design 
Let Bc = {X\B | B € B). Then the incidence structure (X, Вс) is a 
t-(v,v — k, 510854) iz) ) design (provided v > k + #). 


Derived design 
Fix z € X and let Bp = {B\{x}| B € B with z € B}. Then the incidence 
structure (X\{a},Bp) isa (t — 1)-(v — 1, k — 1, А) design. 


Residual design 
Fix z € Xand let Bg = (B | B € Bwithz ¢ В}. Then the incidence 


structure (Х\{2}, Bg) is a (t — 1)-(v — Lk — 1, M, 1) 7% ) design. 
3.5.1.2 The Mathieu 5-design 


The following are the 132 blocks of a 5-(12,6,1) design. The blocks are the supports 
of the weight-6 codewords in the ternary Golay code (page 258). Similarly, the 
supports of the 759 weight-8 codewords in the binary Golay code form the blocks of 
a 5-(24,8,1) design. 


01 2 3 4 1110 1 2 3 5 1010 123 6 3810 123 7 9 
0124 5 0101 2 4 6 1010 12 4 7 8101 25 6 7 
0125 8 1110 1 2 6 9 1110 1 2 7 10 1110 1 2 8 9 10 
01 3 4 5 810 13 4 6 710 13 4 9 1010 13 5 6 9 
01235 7 1110 1 3 6 10 1110 1 3 7 8 1070 1 3 8 9 11 
01 4 5 6 1110 1 4 5 7 1010 1 4 6 8 970 1 4 7 9 11 
0 1 4 8 10 1110 1 5 6 8 1010 1 5 7 8 91/0 1 5 9 10 11 
01 6 7 8 1110 167 9 1010 23 4 5 710 2 3 4 6 9 
02 3 4 8 1010 2 3 5 6 1110 2 3 5 8 910236 7 10 
02 3 7 8 1110 2 3 9 10 1110 2 4 5 6 3810 2 4 5 10 I 
02 4 6 7 1110 247 9 1010 2 4 8 9 1110 2 5 6 9 10 
025 7 8 1010 25 7 9 1110 267 8 910 2 6 8 10 I 
03 4 5 6 1010 3 45 9 1110 3 4 6 8 1110 3 4 7 8 9 
03 4 7 10 1110 3 5 6 7 810 3 5 7 9 1010 3 5 8 10 I 
03 67 9 1110 3 68 9 1010 45 6 7 910 4 5 7 8 M 
0 4 58 9 1010 4 6 7 8 1010 4 6 9 10 1110 5 6 7 10 11 
0 5 6 8 9 1110 7 8 9 10 1111 2 34 5 611213 4 7 10 
12 3 4 8 9112 35 7 811235 9 1111 2 3 6 7 11 
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12 3 6 9 1011 2 3 8 10 1111 2 4 5 7 1111 2 4 5 8 10 
12 4 6 7 0911 2 4 6 8 1111 2 4 9 10 11112 56 8 9 
12 5 6 10 1111 2 5 7 9 1011 26 7 8 1011 2 7 8 9 11 
13 45 7 9113 4 5 10 1111 3 4 6 8 1011 3 4 6 9 11 
13 4 7 8 1111 3 5 6 7 1011 3 5 6 8 1111 3 5 8 9 10 
13 6 7 8 9113 7 9 10 1111 4 5 6 7 811 45 6 9 10 
14 58 9 1111 4 6 7 10 1111 4 7 8 9 1011 5 6 7 9 11 
15 7 8 10 1111 6 8 9 10 1112 3 4 5 8 1123 4 5 9 10 
23 4 6 7 812 3 4 6 10 1123 47 9 1112 3 5 6 7 9 
2 3 5 6 81012 3 5 7 10 1112 3 6 8 9 1112 3 7 8 9 10 
245 6 7 1012 4 5 6 9 1112 45 7 8 912 4 6 8 9 10 
2 4 7 8 10 11 (25 6 7 8 1112 5 8 9 10 1112 6 7 9 10 11 
3.456 7 1113 4 5 6 8 0913 4 5 7 8 10|3 4 6 7 9 10 
3 4 8 9 10 11 3 5 6 9 10 1113 5 7 8 9 1113 6 7 8 10 11 
4 5 6 8 10 1114 5 7 9 10 1114 6 7 8 9 1115 6 7 8 9 10 


3.5.2 BALANCED INCOMPLETE BLOCK DESIGNS (BIBDS) 


Balanced incomplete block designs (BIBDs) аге t-designs with Ё = 2, so that every 
pair of points is on the same number of blocks. The relevant parameters are v, b, r, 
k, and А with 


vr = bk and v(v —1)A = bk(k — 1). (3.5.2) 


If A is the v x b incidence matrix, then AAT = (r — NI, + AJ,, where I, is the 
n X n identity matrix and J, is the n x n matrix of all ones. 


3.5.2.1 Symmetric designs 


Fisher's inequality states that b > v. If b = v (equivalently, r = k), then the BIBD 
is called a symmetric design, denoted as a (v, k, A)-design. The incidence matrix for 
a symmetric design satis es 


ЈА zakl. AJ, and А'А=(ЕЁ—Л)1„ AJ, (3.5.3) 


that is, any two blocks intersect in A points. The dualness of symmetric designs can 
be summarized by the following: 


v points -- v blocks, 
k blocks on a point — k points in a block, and 
Any two points on A blocks <— Any two blocks share A points. 


Some necessary conditions for symmetric designs are 
1. If v is even, then k — A is a square integer. 


2. Bruck-Ryser-Chowla theorem: If v is odd, then the following equation has 
integer solutions (not all zero): 


a? = (k — dy? + (21) 879722. 
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3.5.2.2 Existence table for BIBDs 

Some of the most fruitful construction methods for BIBD are dealt with in sepa- 
rate sections, difference sets (page 246), nite geometry (page 247), Steiner triple 
systems (page 249), and Hadamard matrices (page 249). The table below gives all 
parameters for which BIBDs exist with k < 0/2 and b < 30. 
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3.5.3 DIFFERENCE SETS 


Let G be a nite group of order v (see page 161). A subset D of size k is a (v, k, А)- 
difference set in G if every non-identity element of G can be written A times as 
а "difference" dı 05 1 with dı and Ф іп D. If G is the cyclic group Z,, then the 
difference set is a cyclic difference set. The order of a difference set is n = k — A. 
For example, (1, 2, 4} is a (7,3, 1) cyclic difference set of order 2. 

The existence of a (v, k, A)-difference set implies the existence of a (v, k, A)- 
design. The points are the elements of G and the blocks are the translates of D: all 
sets Dg = {dg : d € D} for g € G. Note that each translate Dg is itself a difference 
set. 


EXAMPLES 
1. Here are the 7 blocks for a (7,3, 1)-design based on D = {1,2,4}: 
124 235 346 450 561 602 013 
2. A (16, 6, 2)-difference set in С = Z» © Z» © Z» Ф Zz is 


0000 0001 0010 0100 1000 1111 


3. A (21,5,1)-difference set in G = (a,b|a? = b =1,a7'ba = a“) is (a, a”, b,b”, 0^). 


3.5.3.4 Some families of cyclic difference sets 


Paley: Let v be a prime congruent to 3 modulo 4. Then the non-zero squares in Z , 
form a (v, (0—1) /2, (v —3)/4)-difference set. Example: (v, k, А) = (11,5,2). 
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Stanton-Sprott: Let v = p(p + 2), where p and p + 2 аге both primes. Then there 
is a (v, (v — 1)/2, (v — 3) /4)-difference set. Example: (v, k, А) = (35,17, 8). 


Biguadratic residues (I): If = 4a? + 1 is a prime with a odd, then the non- 
zero fourth powers modulo v form a (v, (v — 1)/4, (v — 5) /16)-difference set. 
Example: (v, k, A) = (37,9,2). 


Biquadratic residues (П): If v = 4a? + 9 is a prime with a odd, then zero and 
the fourth powers modulo v form a (v, (v + 3)/4, (v + 3)/16)-difference set. 
Example: (v, k, A) = (13,4, 1). 


mc qum] q"—?—1 
ep? 0—1 exl ) 


Singer: Ifgis a prime power, then there exists а ( 


difference set for all m > 3. 


3.5.3.2 Existence table of cyclic difference sets 


This table gives all cyclic difference sets for k < 0/2 and v < 50 up to equivalence 
by translation and multiplication by a number relatively prime to v. 
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3.5.4 FINITE GEOMETRY 
3.5.4.1 Afne planes 


A nite af ne plane is a nite set of points together with subsets of points called 
lines that satisfy the axioms: 


1. Any two points are on exactly one line. 
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2. (Parallel postulate) Given a point Р and a line Ľ not containing Р, there is 
exactly one line through P that does not intersect L. 
3. There are four points, no three of which are collinear. 


These axioms are suf cien t to show that a nite afne plane is a BIBD (see page 
245) with 
v=n b=n +n r=nt+l1l k=n А-і1 
(п is the order of the plane). The lines of a projective plane сап be divided into n +1 
parallel classes each containing n lines. A suf cient condition for af ne planes to 
exist 1s for n to be a prime power. 
Below are two views of the af ne plane of order 2 showing the parallel classes. 


3.5.4.2 Projective planes 


A nite projective plane is a nite set of points together with subsets of points called 
lines that satisfy the axioms: 


1. Any two points are on exactly one line. 
2. Any two lines intersect in exactly one point. 
3. There are four points, no three of which are collinear. 


These axioms are suf cient to show that a nite projective plane is a symmetric 
design (see page 245) with 


v—n -4n4l k2n+1 Х-1 (3.5.4) 


(n is the order of the plane). A suf cien t condition for projective planes to exist is 
for n to be a prime power. 
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A projective plane of order n can be constructed from 
an af ne plane of order n by adding a line at in n ity. 
A line of n + 1 new points is added to the af ne plane. 
For each parallel class, one distinct new point is added 
to each line. The construction works in reverse: re- 
moving any one line from a projective plane of order n 
and its points leaves an af ne plane of order n. To the 
right is the projective plane of order 2. The center cir- 
cle functions as a line at in nity; removing it produces 
the af пе plane of order 2. 


3.5.5 STEINER TRIPLE SYSTEMS 


A Steiner triple system (STS) is a 2-(v,3,1) design. In particular, STSs are BIBDs 
(see page 245). STSs exist if, and only if, v = 1 or 3 (mod 6). The number of 
blocks in an STS is b = v(v — 1)/6. 


3.5.5.1 Some families of Steiner triple systems 


v = 2" — 1: Take as points all non-zero vectors over Z» of length m. A block 
consists of any set of three distinct vectors [z, y, z} such that x + y + z = 0. 


v = 3": Take as points all vectors over Zs of length m. A block consists of any set 
of three distinct vectors [z, y, z} such that x + y + z = 0. 


3.5.5.2 Resolvable Steiner triple systems 


An STS is resolvable if the blocks can be divided into parallel classes such that each 
point occurs in exactly one block per class. A resolvable STS exists if and only if 
v = 3 (mod 6). For example, the af ne plane of order 3 is a resolvable STS with 
9 = 9 (see page 247). 

A resolvable STS with v = 15 (b = 35) is known as the Kirkman schoolgirl 
problem and dates from 1850. Here is an example. Each column of 5 triples is a 
parallel class: 


ab i a c j a d k a e 1 a f m a g n аһ o 
cd f deg e f h f g b s h c h b d bce 
gj o h k i b l j c mk dn 1 e o m fin 
е k n f loo s mi h n j bo k c i l d jm 
h 1ш bmn c n o d o i e ij fj k s k | 


3.5.6 HADAMARD MATRICES 


A Hadamard matrix of order n is an n x n matrix Н with entries +1 such that 
ННТ = nI,. In order for a Hadamard matrix to exist, n must be 1, 2, or a mul- 
tiple of 4. It is conjectured that this condition is also suf cient. If H1 and Н» are 
Hadamard matrices, then so is the Kronecker product Hı © Нә. 
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3.5.6.1 Some Hadamard matrices 


We use “—” to denote —1. 
1.22 п = 4 п = 8 
1 1 1 1 1 1 1 1 
1 1 1 1 
1 1 1 1 1 1 - - 1 1 — - 
1 1 1 — 1 - 1 — - 1 1 — - 1 
1 — 11 - - 1 1 1 1 = — — = 
1 — — 1 1 1 1 1 
11 = = - - 1 1 
1 — — 1 - 1 1 — 
jo Sio ер ам A A оа TÁ 
jo (10-21 1 1 1 
11 1 1 1 1 
I- C2 am. HO d. -dA Wd; 505 m 
Ї! Em 7 xj ma ue Qr 5-5) em uU 
E 1 1 1 1 1 
n = 12 1 ó odo A dq A 
d. 25431 Vel Ойт M 42201228 dp dde е 
1 1 1 1 1 1 
152228 лээ Ws Hex vet ue cm WV 1 5 
{+ 6 Wu Xp 21,252 ve auto ue. © 
1 1 1 1 1 1 
[ de do d а. op he ол лї л d 
1 1 1 1 1 1 1 1 
Шээс 1, эй mum 
j'- 2x m Ди Эд de FE РЕКЕТ 
d. bue 710,.323-7258.22 4222 ММ aah, ae ES es Z 
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3.5.6.2 Designs and Hadamard matrices 


Without loss of generality, a Hadamard matrix can be assumed to have a rst row 
and column consisting of all +1s. 


BIBDs: Delete the rst row and column. The points of the design are the remaining 
column indices. Each row produces a block of the design, namely those indices 
where the entry is +1. The resulting design is an (n — 1, (n — 2) /2, (n — 4)/4) 
symmetric design (see page 249). 


3-Designs: The points are the indices of the columns. Each row, except the rst 
row, yields two blocks, one block for those indices where the entries are +1 
and one block for those indices where the entries are —1. The resulting design 
is a 3-(n,n/2, (n — 2)/2) design. 
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3.5.7 LATIN SOUARES 


A Latin square of size n is an n x n array S = [s,;] of n symbols such that every 
symbol appears exactly once in each row and column. Two Latin squares S and T 
are orthogonal if every pair of symbols occurs exactly once as a pair (s ;;,t;;). Let 
M (n) be the maximum size of a set of mutually orthogonal Latin squares (MOLS). 


n) =n —lifnisa prime power. 
173) > min( M (n1), M (n3)). 
= 1 (1.e., there are no two MOLS of size 6). 
. M(n) > 2 for all n > 3 except n = 6. (Latin squares of all sizes exist.) 


po ES 
ЖЕКЕШЕ 


The existence of n — 1 MOLS of size n is equivalent to the existence of an af ne 
plane of order n (see page 247). 


3.5.7.1 Examples of mutually orthogonal Latin sguares 
These are complete sets of MOLS for n = 3, 4, and 5. 


8, 9, and 10. 


n=8 


12105 [30 [21 [56 (47 (74 [65 | 
(24 [35 [06 [17 (60 [7 [42 [53 | 
(33 [22 [11 [00 [77 [66 (55 [44 | 
(46 (57 (64 75 [02 [13 [20 [31 | 
E57 46 75 [61 [13 [02 [31 [20] 
Fes 74 [47 [56 [21 [30 (03 [12 | 
(71 60:55 [42 [35 (28 [17 [06 | 
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1 | 22 


= 9 
33 | 44 | 55 | 66 | 77 | 88 | | 00 | 67 | 58 | 49 | 
| 53 | 34 | 78 | 86 | 67 Pre [ror foe ss 
| 35 | 43 | 87 | 68 | 76 
| 94 | 86 | 71 | 33 | 2 
| 80 | 61 | 15 | 23 | 04 | | 19 | 95 | 80 | 72 | 
| 38 | 29 | 96 | 81 | 
| 57 | 48 | 39 | 90 | 
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3.5.8 ROOM SQUARES 


A Room square of side n is an n x n array with entries either empty or consisting of 
an unordered pair of symbols from a symbol set of size n + 1 with the requirements: 


1. Each symbol appears exactly once in each row and column. 
2. Every unordered pair occurs exactly once in the array. 


Room squares exist if and only if n is odd and n > 7. 
A Room square yields a construction of a round-robin tournament between n +1 
opponents over n rounds and played at n locales: 


1. Rows of the square represent rounds in the tournament. 
2. Columns in the square represent locales. 
3. Each pair represents one competition. 


Then each team plays exactly once in each round, at each locale, and against each 
opponent. 


EXAMPLE This is a Room square of side 7: 


п] | [26| ]|57[34 


3.5.9 COSTAS ARRAYS 


An n xn Costas array is an array of zeros and ones whose two-dimensional autocor- 
relation function is n at the origin and no more than 1 anywhere else. There are В, 
basic Costas arrays; there are С; arrays when rotations and ips are allowed. Each 
array can be interpreted as a permutation. 


їп [123 45 6 78 9 0 I 2 


2 6 17 13 17 30 60 555 990 


12 40 116 200 444 760 2160 4368 7852 
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B 4 15 16 17 18 19 20 


By, | 1616 2168 2467 2648 2294 1892 1283 810 
С, | 12828 17252 19612 21104 18276 15096 10240 6464 


3.6 COMMUNICATION THEORY 


3.6.1 INFORMATION THEORY 


3.6.1.1 De nitions 


Let px = (ps, pas; - -> Da, ) be the probability distribution of the discrete random 
variable X with Prob (X = x;) = py,. The entropy of the distribution is 


Н(рх) = – у De; logy Ре. (3.6.1) 
24 


The units for entropy are bits. Entropy measures how much information is gained 
from learning the value of X. When X takes only two values, р = (p, 1 — р), then 


H(px) = H(p.1— p) = —plog; p — (1 — p) logy (1 — p). (3.6.2) 


This is also denoted H(p). The range of H(p) is from 0 to 1 with a maximum at 
р = 0.5. Below is a plot of p versus H (p). The maximum of H (p x) is log, n and is 
obtained when X is uniformly distributed, taking n values. 


1 
0.8 
0.6 
0.4 
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Given two discrete random variables X and Y, р y „y is the joint distribution of 
X and Y. The mutual information of X and Y is de ned by 


(X,Y) = Н(рх) + H(py) - Н(рхху). (3.6.3) 


Note that (a) Z(X, Y) = NY, X): (D TX, Y) > 0; and (c) Т(Х,Ү) = Oif, and only 
if, X and Y are independent. Mutual information gives the amount of information 
that learning a value of X says about the value of Y (and vice versa). 


3.6.1.2 Continuous entropy 


For a d-dimensional continuous random variable X, the entropy is 


A(X) = — = p(x) log p(x) dx. (3.6.4) 


Continuous entropy is not the limiting case of the entropy of a discrete random 
variable. In fact, if X is the limit of the one-dimensional discrete random variable 
{Xn}, and the entropy of X is nite, then 


lim (H(Xp) — nlog2) = h(X). (3.6.5) 


n— оо 


If X and Y are continuous d-dimensional random variables with density func- 
tions p(x) and g(y), then the relative entropy is 


Н(Х,Ү) = 1: p(x) log их ах. (3.6.6) 


A d-dimensional normal (or Gaussian) random variable N (a, Г) has the density 
function 


1 1 pt. 
g(x) — en? T] exp Gc -a)r (x- 3 (3.6.7) 


where a is the vector of means and Г is the positive de nite covariance matrix. 


1. ЕХ = (X1, Xo,..., Ха) is a d-dimensional normal random vector with dis- 


tribution N (a, Г) then A(X) = 3 log 22 г). 


= 5, 


2. Хаш Y аге d-dimensional normal random vectors with distributions N (a, Г) 
and N(b, A) then 


H(X,Y) = 5 c m + tr (T (A7! — r7)) + (a - b)" AT“! (a — b) 
(3.6.8) 


3. If X is a d-dimensional normal random vector with distribution N (a, Г), and if 
Y is a d-dimensional random vector with a continuous probability distribution 
having the same covariance matrix Г, then A(X) < ЖҮ). 
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3.6.1.3 Channel capacity 


The transition probabilities are de ned by tz у = Prob (Y = y | X = x). The distri- 
bution р y determines py by py = У% ур. The matrix Т = (t,,,) is the transition 
matrix. The matrix T de ne s a channel given by a transition diagram (input is X, 
output is Ү ). For example (here X and Y only take two values), 


Zo Lao, yo Yo 


The capacity of the channel is de ned as 


C = max I(X,Y). (3.6.9) 
Px 


A channel is symmetric if each row is a permutation of the rst row and each 
column is a permutation of the rst column. The capacity of a symmetric channel 
is C = log; n — H(p), where p is the rst row; the capacity is achieved when p x 
represents equally likely inputs. The channel shown on the left is symmetric; both 
channels achieve capacity with equally likely inputs. 


Binary symmetric channel Binary erasure channel 


0 1-р 0 0 Ip 0 


1—р 1—р 
C=1-H(p) С-1-р 


3.6.1.4 Shannon's theorem 


Let both X and Y be discrete random variables with values in an alphabet А. A code 
is a set of codewords (n-tuples with entries from A) that is in one-to-one correspon- 
dence with a set of M messages. The rate R of the code is de ned as + log, М. 
Assume that the codeword is sent via a channel with transition matrix T by sending 
each vector element independently. De ne 


e= max  Prob((codeword incorrectly decoded)). (3.6.10) 


all codewords 
Shannon's coding theorem states: 


1. If R < C, then there is a sequence of codes with rate R and n — oo such that 
e — 0. 


2. If R > C, then e is always bounded away from 0. 
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3.6.2 BLOCK CODING 
3.6.2.1 De nitions 


A code C over an alphabet A is a set of vectors of a x ed length n with entries from 
A. Let A be the nite eld GF(g) (see Section 2.7.6.1). If C is a vector space over 
A, then С is a linear code; the dimension k of a linear code is its dimension as a 
vector space. The Hamming distance dn(u, v) between two vectors, u and v, is the 
number of places in which they differ. For a vector u over GF(g), de ne the weight, 
wt(u), as the number of non-zero components. Then dn(u,v) — wt(u — v). The 
minimum Hamming distance between two distinct vectors in a code C is called the 
minimum distance d. A code can detect e errors if e < d. A code can correct t errors 
if 2t - 1 « d. 


3.6.2.2 Coding diagram for linear codes 
Encoding Channel Decoding 


уН syndrome 


1. A message x consists of k information symbols. 


2. The message is encoded as xG € C, where G is a k x n matrix called the 
generating matrix. 


3. After transmission over a channel, a (possibly corrupted) vector y is received. 


4. There exists a parity check matrix H such that c € C if and only if cH = 0. 
Thus the syndrome z = уН can be used to try to decode y. 


5. If G has the form [J A], where I is the k x k identity matrix, then H = [7] à 


Note: in coding theory unspeci ей vectors are usually row vectors. 


3.6.2.3 Cyclic codes 

A linear code C of length n is cyclic if (ao,...,a4—1) € C implies (an 1,80, ..., 
an—2) € C. To each codeword (ao, à1,..., 041) € C is associated the polynomial 
a(x) = Y air). Every cyclic code has a generating polynomial g(x) such that 
a(x) corresponds to a codeword if, and only if, a(x) = d(x)g(r) (mod x" — 1) 
for some d(x). The roots of a cyclic code are roots of g(x) in some extension eld 
GF(q') with primitive element a. 


1. BCH Bound: If a cyclic code C has roots a“, a^*!,. . . , 01^ 472, then the min- 
imum distance of C is at least d. 
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2. Binary ВСН codes (ВСН stands for Bose, Ray-Chaudhuri, and Hocguenghem): 
Fix m, de ne n = 2™ — 1, and let a be a primitive element in GF(2™). De ne 
fi(x) as the minimum binary polynomial of a“. Then 


g(x) = LCM (fi (x),..., fae(x)) (3.6.11) 


de ne s a generating polynomial for a binary BCH code of length n and mini- 
mum distance at least 6 = 2e + 1 (ô is called the designed distance). The code 
dimension is at least n — me. 


3. Dual code: Given a code С, the dual code is C+ = {a | a: x = 0 for all 
x € С}. The code C+ is an (n,n — k) linear code over the same eld. A code 
is self-dual if С = C+. 


4. MDS codes: A linear code that meets the Singleton bound, n + 1 = k + d, is 
called MDS (for maximum distance separable). Any k columns of a generating 
matrix of an MDS code are linearly independent. 


5. Reed-Solomon codes: Let a be a primitive element for GF(g) and n = g — 1. 
The generating polynomial g(a) = (x — o)(z — a“)--- (x — at") de nes a 
cyclic MDS code with distance d and dimension k — n — d + 1. 


6. Hexacode: The hexacode is a (6,3, 4) self-dual MDS code over GF(4). Let 
the nite eld offourelements be (0, 1, a,b} with = a? = a+1. The code is 
generated by the vectors (1,0, 0, 1, 5, a), (0, 1,0, 1, a, b), and (0,0, 1, 1, 1, 1). 
The 64 codewords are: 


000000 1001ba а00а15 bOObal 010lab 110011 alObbO b10a0a 
Oa0abi 1a0bOb aa00aa ba0110 ObObla 1bOaa0 ab0101 ЪЪООЬЬ 
001111 1010ab а01Ь0а bO1abO 0110Ба 111100 а11аа1 biibib 
OalbaO 1а1а1а aaiibb bai001 OblaOb 151551 ab1010 bbliaa 
00аааа 10ар10 alaObl bOalOb OlabOi 1laabb а1а11а blala0 
QOaa0ib 1аа1а! аааа00 baabba ObalbO 1ba00a ababab bbaali 
OObbbb 10ba01 aObiaO 50501а 01Ба10 11bbaa albOOb blbibi 
0ар10а4 1abObO aabbii babaab Obblal 15115 abbaba bbbboOO. 


7. Perfect codes: A linear code is perfect 1f 1t satis es the Hamming bound, 
а"—*® = Ууз (7) (a — 1). The binary Hamming codes and Golay codes 
are perfect. 


8. Binary Hamming codes: These codes have parameters (n = 2" — 1, k = 
2 —1 —m,d = 3+. The parity check matrix is the 2™ — 1 x m matrix whose 
rows are all of the binary m-tuples in a x ed order. The generating and parity 
check matrices for the (7, 4) Hamming code are 


A sb oo 
10 0 0 1 1 0 DE 
0 1 0 0 1 0 1 -А 
A атар н ерт 
00 0 1 1 1 1 0 1 0 
00 1 
(3.6.12) 


© 2003 by CRC Press LLC 


9. Binary Golay code: This has the parameters {n 


generating matrix is 


8-1 А] = 


100000000000 
010000000000 
001000000000 
000100000000 
000010000000 
000001000000 
000000100000 
000000010000 
000000001000 
000000000100 
000000000010 
000000000001 


24, Е 


12,4 


011111111111 
111011100010 
110111000101 
101110001011 
111100010110 
111000101101 
110001011011 
100010110111 
100101101110 
101011011100 
110110111000 
101101110001 


8}. The 


(3.6.13) 


10. Ternary Golay code: This has the parameters {n = 12,k = 6,d = 6}. The 


generating matrix is 


8-1 А|- 


3.6.2.4 Bounds 


Bounds for block codes investigate the trade-offs between the length n, the number 
of codewords M, the minimum distance d, and the alphabet size g. The number of 
errors that can be corrected is e with 2e +1 < d. If the code is linear, then the bounds 
concern the dimension k with M = 4%. 


1. 


2. 


Hamming or sphere-packing bound: M < а" / Улс (2)(a — 1). 
Plotkin bound: Suppose that d > n(q — 1)/q. Then M < 


Singleton bound: For any code, M < g 


k+d<n+1. 


100000 
010000 
001000 
000100 
000010 
000001 


n—d+1. if the code is linear, then 


011111 
101221 
110122 
1210121” 
122101 
112210 


4 


аа 
ad—n(4—1)" 


(3.6.14) 


Varsharmov-Gilbert bound: There is a block code with minimum distance at 


least d and M > g" / 
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ži nd ja STE. 


3.6.2.5 Table of binary BCH codes 


3.6.2.6 Table of best binary codes 


Let A(n,d) be the number of codewords! in the largest binary code of length п 
and minimum distance d. Note that A(n — 1,d — 1) = A(n,d) if d is odd and 
A(n,2) = 2"71 (given, e.g., by even weight words). 


144 
256 
512 


1024 


=n 
с 


2048 
2720-3276 
5312-6552 
10496-13104 1024-1288 
20480-26208 2048-2372 


36864-43690 2560-4096 
73728-87380 4096-6942 
147456-173784 | 8192-13774 
294912—344636 | 16384-24106 


= 
© 


! Data from Sphere Packing, Lattices and Groups by J. H. Conway and N. J. A. Sloane, 3rd ed., 
Springer-Verlag, New York, 1998. 
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3.6.3 SOURCE CODING FOR ENGLISH TEXT 


English text has, on average, 4.08 bits/character. 


3.6.4 MORSE CODE 


Probability | Huffman code | Alphabetical code 
000 00 


Space 
A 
B 
С 
р 
Е 
Е 
G 
H 
I 
J 
K 
L 
M 
N 
О 
Р 
Q 
R 
S 
T 
U 
V 
W 
X 
Y 
Z 


0100 
011111 
11111 
01011 


101 
001100 
011101 
1110 
1000 


0111001110 
01110010 
01010 
001101 
1001 


0110 
011110 
0111001101 
1101 

0010 


0010 

11110 
0111000 
001110 
0111001100 


001111 
0111001111 


0100 
010100 
010101 
01011 


0110 
011100 
011101 
01111 
1000 


1001000 
1001001 
100101 
10011 
1010 


1011 
110000 
110001 
11001 
1101 


1110 
111100 
111101 
111110 
1111110 


11111110 
11111111 


4.0799 4.1195 4.1978 


The international version of Morse code is 


A K 1 
B L 2 
C M 3 
D N 4 
E О 5 
Е Р 6 
G Q 7 
H R Period 8 
I S Comma 9 
J T Ouestion 0 
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3.6.5 GRAY CODE 


A Gray code is a seguence ordering such that a small change in the seguence number 
results in a small change in the seguence. 


EXAMPLES 


1. The sixteen 4-bit strings (0000, 0001,..., 1111) can be ordered so that adjacent bit 
strings differ in only 1 bit: 


Biting Bit sing 
0 8 


2. The subsets of fa, b, с} can be ordered so that adjacent subsets differ by only the inser- 
tion or deletion of a single element: 


Ф, {а}, {a,b}, {b}, {b, c}, {a,b, c}, {a,c}, {с}. 


3.6.6 FINITE FIELDS 


Pertinent de nitio ns for nite elds may be found in Section 2.7.6 on page 169. 


3.6.6.1 Irreducible polynomials 


Let N, (n) be the number of monic irreducible polynomials of degree n over GF(q). 
Then 


= ий „at Mine 2» (De. Өөө 
dln dln 


where u(-) is the number theoretic Möbius function (see page 102). 


3.6.6.2 Table of binary irreducible polynomials 


The table lists the non-zero coef cien ts of binary irreducible polynomials, e.g., 2 1 0 
corresponds to r“ +x! -- 39 = z? +2 +1. The exponent of an irreducible polynomial 
is the smallest Ľ such that f(x) divides x” — 1. A “P” after the exponent indicates 
that the polynomial is primitive. 
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310 ТР 
410 15Р 
420 15Р 


43210 


73210 
740 
74320 
75210 
75310 
75430 
7543210 
760 
76310 
76410 
76420 
76520 
7653210 
76540 
7654210 
7654320 
84310 
84320 
85310 
85320 
85430 
8543210 
86320 


8643210 
86510 
86520 
86530 
86540 
8654210 
8654310 
87210 
87310 
87320 
8743210 
87510 
87530 
87540 
8754320 
87610 
8763210 
8764210 
8764320 
8765210 
8765410 
8765420 
8765430 


3.6.6.3 Table of binary primitive polynomials 


Listed below? are primitive polynomials, with the least number of non-zero terms, 
of degree from 1 to 64. Only the exponents of the non-zero terms are listed, e.g., 2 1 


0 corresponds to x“ + x + 1. 


134310 266210 


2Taken in part from “Primitive Polynomials (Mod 2)", Е. J. Watson, Math. Comp., 16, 368-369, 1962. 
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32753210 


336410 
34765210 
3520 
36654210 
37543210 
386510 
3940 


42543210 
436430 
446520 
454310 
46853210 
4750 
48754210 
496540 
504320 
516310 
5230 


54654320 
556210 
567420 
575320 
586510 
59654310 
6010 
615210 
626530 
6310 
644310 


3.6.7 BINARY SEQUENCES 


3.6.7.1 Barker sequences 

A Barker sequence is a sequence (s1,52,...,SN) with s; = +1 such that 

лэ 8)8)-6 = +1 ог0, for i = 1,..., N — 1. The following table lists АП known 
Barker seguences (up to reversal, multiplication by —1, and multiplying alternate 
values by —1). 


+1 Sl 
—1 41 —1 —1 41 -1 
—1 si +1 +1 —1 +1 21. +1 


3.6.7.2 Periodic seguences 


Let s = (50,51,.-..,5N—1) be a periodic sequence with period N. A (left) shift 
of s is the sequence (81,...,8м-1,580). For r relatively prime to N, the decima- 
tion of s is the sequence (50, S+, 527, ..), which also has period N. The periodic 
autocorrelation is de ned as the vector (ао,...,ам-1), with 


N-1 
a: = > 8181-41, (subscripts taken modulo N). (3.6.16) 
j=0 


An autocorrelation is two-valued if all values are equal except possibly for the 0" 
term. 


3.6.7.3 Тһе m-sequences 
A binary m-seguence of length N = 2" — 1 is the sequence of period N de ne 4 by 


(80,81,...,8м-41), s; = Tr(a’), (3.6.17) 


where a is a primitive element of GF(2") and Tr is the trace function from GF(2") 
to GF(2) de ned by Tr(g) = 8 + 82+ 8^ 4... 827. 


1. All m-seguences of a given length are equivalent under decimation. 

2. Binary m-sequences have a two-valued autocorrelation (with the identi cation 
that 0 + +1 and 1 + —1). 

3. АП m-sequences possess the span property: all binary r-tuples occur in the 
seguence except the all-zeros r-tuple. 


The existence of a binary seguence of length 2" — 1 with a two-valued autocor- 
relation is eguivalent to the existence of a cyclic difference set with parameters 
(2^ — 1,2n71 — 1,2"—2 — 1). 
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3.6.7.4 Shift registers 


Below are examples of the two types of shift registers used to generate binary m- 
sequences. The generating polynomial in each case is x4 + x + 1, the initial register 
loading is 1 0 0 0, and the generated sequence is (0, 0, 0, 1, 0, 0, 1, 1, 0, 1, 0, 1, 1, 1, 


D 


Additive shift register Multiplicative shift register 
rarae 
© щт Ыр 


3.6.7.5 Binary seguences with two-valued autocorrelation 


The following table lists all binary sequences with two-valued periodic autocorrela- 
tion of length 2" — 1 form = 3 to 8 (up to shifts, decimations, and complementation). 
The table indicates the positions of 0: the remaining values are 1. An S indicates that 
that seguence has the span property. 


Positions of 0 
124 
01245810 


P12346812 1S 1617232427290 — — — — — — — — 
[1215789 1014161819202528 OOS 
[012346789 1213 4 16 181024262728 3233 35 3638 31483819323436  — — — — 
[012345689 101216 17182023 24 2729 32 33 M 364043454648 335458. — — 
248911 13 15 16 17 18 19 21 22 25 26 30 31 32 34 35 36 37 38 41 42 44 47 49 50 52 60 61 62 64 68 
69 70 71 72 73 74 776 79 81 82 84 87 88 94 98 99 100 103 104 107 113 115 117 120 121 122 124 
23456781012 14 16 19 20 23 24 25 27 28 32 33 38 40 46 47 48 50 51 54 56 57 61 63 64 65 66 67 
73 75 76 77 80 87 89 92 94 95 96 97 100 101 102 107 108 111 112 114 117 119 122 123 125 126 
123467891214 15 16 17 18 24 27 28 29 30 31 32 34 36 39 47 48 51 54 56 58 60 61 62 64 65 67 68 
71 72 T1 78 79 83 87 89 94 96 97 99 102 103 105 107 108 112 113 115 116 117 120 121 122 124 
23467891213 14 16 17 18 19 24 25 26 27 28 31 32 34 35 36 38 47 48 50 51 52 54 56 61 62 64 65 
67 68 70 72 73 7677 79 81 87 89 94 96 97 100 102 103 104 107 108 112 115 117 121 122 124 
23456891012 15 16 17 18 19 20 24 25 27 29 30 32 33 34 36 38 39 40 48 50 51 54 55 58 59 60 64 
65 66 68 71 72 73 76 77 78 80 83 89 91 93 96 99 100 102 105 108 109 110 113 116 118 120 
2345681011 12 16 19 20 21 22 24 25 27 29 32 33 37 38 39 40 41 42 44 48 49 50 51 54 58 63 64 65 
66 69 73 74 76 77 78 80 82 83 84 88 89 95 96 98 100 102 105 108 111 116 119 123 125 126 


БЕШ 
|05 | 
|6 | 
jú 0123467812 13 14 16 17 19 23 24 25 26 27 28 31 32 34 35 37 38 41 45 46 48 49 50 51 52 54 56 59 
ú 
р 
Ё 


62 64 67 68 70 73 74 75 76 82 85 90 92 96 98 99 100 102 103 104 105 108 111 112 113 118 119 123 124 
127 128 129 131 134 136 137 139 140 141 143 145 146 148 150 152 153 157 161 164 165 170 177 179 
180 183 184 187 189 191 192 193 196 197 198 199 200 204 206 208 210 216 217 219 221 222 223 224 
226 227 236 237 238 239 241 246 247 248 251 253 254 
012478911 14 16 17 18 19 21 22 23 25 27 28 29 32 33 34 35 36 38 42 43 44 46 49 50 51 54 56 58 61 
64 66 68 69 70 71 72 76 79 81 84 85 86 87 88 89 92 93 95 97 98 99 100 101 102 108 112 113 116 117 119 
22 125 128 131 132 133 136 137 138 139 140 141 142 144 145 149 152 153 158 162 163 167 168 170 
71 172 174 175 176 177 178 184 186 187 190 193 194 196 197 198 200 202 204 209 211 213 215 216 
221 224 226 232 233 234 235 238 244 245 250 
0123468 12 13 15 16 17 24 25 26 27 29 30 31 32 34 35 39 47 48 50 51 52 54 57 58 59 60 61 62 64 67 
68 70 71 78 79 85 91 94 96 99 100 102 103 104 107 108 109 114 116 118 119 120 121 122 124 127 128 
29 134 135 136 140 141 142 143 145 147 151 153 156 157 158 161 163 167 170 173 177 179 181 182 
87 188 191 192 195 198 199 200 201 203 204 206 208 209 211 214 216 217 218 221 223 225 227 228 
229 232 233 236 238 239 240 241 242 244 247 248 251 253 254 

0123467811 12 14 15 16 17 21 22 23 24 25 28 29 30 32 34 35 37 41 42 44 46 47 48 50 51 56 58 60 64 
68 69 70 71 73 74 81 82 84 85 88 91 92 94 96 97 100 102 107 109 111 112 113 116 119 120 121 123 127 
28 129 131 133 135 136 138 139 140 142 145 146 148 151 153 162 163 164 168 170 173 176 181 182 
83 184 187 188 189 191 192 193 194 195 197 200 203 204 209 214 218 219 221 222 223 224 225 226 
229 232 237 238 239 240 242 246 247 251 253 254 
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3.7 DIFFERENCE EGUATIONS 


3.7.1 THE CALCULUS OF FINITE DIFFERENCES 


1. A(f(z)) = f(z +h) — f(x) (forward difference). 
2. А2(/(2)) = f(a + 2h) - 2f(a + h) + f(a). 


3. A^((2)) = A (A706) = DDE (1) f + (в — Юл). 
) 


k—0 


4. A(cf(z)) = cA(f(x)) 
5. A(f(a) + g(x)) = А(Қа)) + A(g(z)) 
6. A(f(x)g(z)) = JETE NA ТҮЙ) Тай 
(«)\ _ g(x x)) — f(x)A (g(x 
| A (42) = 401857) , provided that g(x)g(a +h) z 0. 


3.7.2 EXISTENCE AND UNIQUENESS 


A difference equation of order k has the form 


Entk = f (En, £n41,. End (k 21): 0) (3.7.1) 


where f 1s a given function and k is a positive integer. A solution to Eguation (3.7.1) is 
a seguence of numbers GS which satis es the equation. Any constant solution 
of Equation (3.7.1) is called an equilibrium solution. 

A linear difference equation of order k has the form 


а зр + dl Dg. itg) pera na +a an = In, (3.7.2) 


where k is a positive integer and the coef cients ад) Аы» ад along with {gn} are 


known. If the sequence gn is identically zero, then Equation (3.7.2) is called homo- 
geneous; otherwise, it is called non-homogeneous. If the coef cients 410)» —À ад 
аге constants (1.е., do not depend оп т), Equation (3.7.2) is a difference equation with 


constant coef cients; otherwise it is a difference equation with variable coef cients. 


THEOREM 3.7.1 (Existence and uniqueness) 
Consider the initial-value problem (IVP) 


Intk + КЕЗУ e. iaa) ++ bP ant + PR = Жуз 


(3.7.3) 
Ti — Oi, 12—0,1,...,k —1, 


for n = 0,1,... where 59 and f, are given sequences with 50) # 0 for all n and 
the {a;} are given initial conditions. Then the above equations have exactly one 
solution. 
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3.7.3 LINEAR INDEPENDENCE: GENERAL SOLUTION 


The sequences x), x2),..., 409) (sequence 2%) has the terms (2(7,20),20),...)) 
are linearly dependent if constants c1, co, ..., ск (not all of them zero) exist such that 
k 
b ашиг forn =0,1,.... (3.74) 
121 
Otherwise the sequences x), 12),..., 09 are linearly independent. 
The Casoratian of the k sequences x), 7), ..., 20918 the k x k determinant 
200 a?) a) 
(1) (2) a (k) 
C (44) ee 59) =| ®nt1 бан Tritt |. 6715) 
(1) (2) (k) 
Ta k—1 2-1 Untk—-l 
THEOREM 3.7.2 
The solutions „0, х0), хо; ж of the linear homogeneous difference eguation, 
uk FE D афва) Tec Ku, + 00922, = 0, n = 0,1,..., (3.7.6) 


are linearly independent if, and only if, their Casoratian is different from zero for 
n — 0. 


Note that the solutions to Equation (3.7.6) form a k-dimensional vector space. 
The set (4:0),20),...,409)3 is a fundamental system of solutions for Equation 
(3.7.6) if, and only if, the sequences х0), 102), Soi х\® are linearly independent 
solutions of the homogeneous difference Equation (3.7.6). 


THEOREM 3.7.3 


Consider the non-homogeneous linear difference equation 

тағы ЫС ens ea + +O tng + =, — n—0,L... (377) 
where of ) and а, are given sequences. Let т be the general solution of the corre- 
sponding homogeneous eguation 


(1) 


ďn+k + BE) ыы) +++ bn 


тп +6002, = 0, =з 


and let д?) be a particular solution of Eguation (3.7.7). Then rP + as) is the 
general solution of Equation (3.7.7). 
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THEOREM 3.7.4 (Superposition principle) 

Let x) and т) be solutions of the non-homogeneous linear difference equations 
Ink + БЭ (ьт) ры ра; БЫ) ын +00 2, -о,, п=0,1,..., 

and 


Intk + БЭ ea (1) ESS аа + b an = Ва, n= 0, 1, шах 


respectively, where b) and fan and {8n} are given sequences. Then a + x(2) 
is a solution of the eguation 


Ln+k + БЕЗУ, ua) spes D tnpa +P rn =Qn+Bn, п=0,1,.... 


3.7.4 HOMOGENEOUS EQUATIONS WITH CONSTANT 
COEFFICIENTS 


The results given below for second-order linear difference equations extend naturally 
to higher order equations. 
Consider the second-order linear homogeneous difference equation, 


022542 + 019541 + Q0Tn = 0, (3.7.8) 


where the {a;} are real constant coef cients with ахау # 0. The characteristic 
eguation corresponding to Eguation (3.7.8) is de ned as the guadratic eguation 


22N + ayA + ag = 0. (3.7.9) 


The solutions Ду, Az of the characteristic equation аге the eigenvalues or the charac- 
teristic roots of Equation (3.7.8). 


THEOREM 3.7.5 


Let A, and № be the eigenvalues of Equation (3.7.8). Then the general solution of 
Equation (3.7.8) is given as described below with arbitrary constants c4 and ca. 


Case 1: Л; Z A» with M, № € R (real and distinct roots). 
The general solution is given by £n = с1АТ + со A3. 


Case 2: A = k € R (real and equal roots). 
The general solution is given by £n = GAP + сопА?. 


Case 3: M = № (complex conjugate roots). 
Suppose that X = re'?. The general solution is given by 


Ln = cir" соѕ(пф) + car" sin(nQ). 


The constants (ci, сә) are determined from the initial conditions. 
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EXAMPLE The unique solution of the initial-value problem 


Phys = Ра + Fh, n —0,1,..., 


(3.7.10) 
Б,-0, А =1, 


is the Fibonacci sequence. The equation А? = A + 1 has the real and distinct roots 
A1.2 = 5. Using Theorem 3.7.5 the solution is 


n- 2132) - (52), n=0,1,.... (3.7.11) 


3.7.5 NON-HOMOGENEOUS EQUATIONS 


THEOREM 3.7.6 (Variation of parameters) 


Consider the difference equation, тээ + Anďn+1 + Бата = Yn, where {an}, 
{Bn}, and (^) are given sequences with Bn £ 0. Let x!) and x) be two linearly 
independent solutions of the homogeneous equation corresponding to this equation. 
A particular solution x) has the component values т?) = ть) ta? y2) where 
the sequences v“) and v) satisfy the following system of equations: 


a Gen Е 29 + a), (0, — uf) =0, and 


22 (v = 29 s шэг (vf. = 29 — M. 


(3.7.12) 


3.7.6 GENERATING FUNCTIONS AND Z TRANSFORMS 


Generating functions can be used to solve initial-value problems of difference equa- 
tions in the same way that Laplace transforms are used to solve initial-value problems 
of differential equations. 

The generating function of the sequence (т, +, denoted by С], is de ned by 
the in nite series 


Glan] = Y ans” (3.7.13) 
n=0 


provided that the series converges for |s| < r, for some positive number r. The 
following are useful properties of the generating function: 


1. Linearity: G [c2 + Yn] = 1G [£n] + CoG [yn]. 
k—1 
NS : 1 
2. Translation invariance: G |£n+k] = = (c [xa] — У zas") ; 
s n=0 


3. Uniqueness: G [tn] = G [yn] © tn = yn for п = 0,1,.... 
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The Z-transform of a sequence {x,,} is denoted by Z [x,,] and is de ned by the 


in nite series, 
oo 


x 
ЕЛІ = —, 
n=0 2" 


(3.7.14) 


provided that the series converges for |z| > r, for some positive number r. 

Comparing the de nitions for the generating function and the Z-transform one 
can see that they are connected because Equation (3.7.14) can be obtained from 
Equation (3.7.13) by setting s = z—!. 


Generating functions for some common sequences 


(Bn) s sin д 
sin 
1 —25cos 8 + s? 
(8) 1—scosf 
COS 
" 1 —2scosB + s? 


as ___ авашд ——— 
1 — 2авсов8 + ažs? 


1 — as | l-ascosB 00) 
1 — 2a5 cos 8 + ažs? 


3.7.7 CLOSED-FORM SOLUTIONS FOR SPECIAL EQUATIONS 


In general, itis dif cult to nd aclosed-form solution for a difference equation which 
is not linear of order one or linear of any order with constant coef cien ts. A few spe- 
cial difference equations which possess closed-form solutions are presented below. 


3.7.7.1 First order equation 


The general solution of the rst-order linear difference equation with variable 
coef cien ts, 
In41 — Onfga = Dg, n=0,1,..., (3.7.15) 
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is given by 


n—1 n—2 т-і1 
s (По) + ŽL | П oc) Bn + Aa n=0,1,... 
k=0 m 


-0 \k=m+1 


where 20 is an arbitrary constant. 


3.7.7.2 Riccati equation 


Consider the non-linear rst-ord er equation, 


_ Gnďn t Bn = 
1141 = ——— n=0,1,..., 
Әп т + On 


where an, Bn, Yn, On are given sequences of real numbers with 


^w #0 and #0, п =0,1,.... 


Om Bn 
ба 


Yn 


The following statements are true: 


1. The change of variables, 


Un+1 
— — = “үрд + би, n=0,1,..., 
Un 

uo = 1, 


reduces Equation (3.7.17) to the linear second-order equation, 
Un+2 = AnUn + Bn, n=0,1,..., 
uo = 1, 


ші = 70% + бо, 


where А, = n41 + Gn a ‚апі Bn = (By Yn — Ondn) Inti 


n n 


‚ (37.16) 


(3.7.17) 


(3.7.18) 


(3.7.19) 


(3.7.20) 


2. Let 2) be a particular solution of Equation (3.7.17). The change of variables, 


1 
(р)? 


Ln — Xn 


Un = n=0,1,..., 


reduces Equation (3.7.17) to the linear rst-order equation, 


Unti + Съ? + Dn = 0, n=0,1,..., 


(за? E 5) : 


Yn (за E ön) 
BnYn = баба | 


here С„ = 
шы BnY¥n - Andn 


‚апа D, = 
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(3.7.21) 


(3.7.22) 


3. Let x) and 20) be two particular solutions of Equation (3.7.17) with az Z 
202) forn = 0, 1,.... Then the change of variables, 


п-0,1,..., (3.7.23) 


reduces Equation (3.7.17) to the linear homogeneous rst-order equation, 
Wnt1 + EnWn = 0, nim us (3.7.24) 


(а) + bn) 


where E, = 
В BnYn = аъ 


3.7.7.3 Logistic eguation 


Consider the initial-value problem 
In 
pre (1 2 —) ra (3.7.25) 
20 =Q, with a € [0, k], 
where r and k are positive numbers with r < 4. The following are true: 


1. When r = k = 4, Equation (3.7.25) reduces to 


Ent1 = 4n — T2. (3.7.26) 
If a = 4sin“ (6) with 0 € (0, 2], then Equation (3.7.26) has the closed-form 
solution 
Түр: 4sin(2"+!g), п =0,1,..., (3.7.27) 
zo = Asin? (9), with 9 € (0, Z]. 


2. When r = 4 and k = 1, Equation (3.7.25) reduces to 


ful = 424 — 422. (3.7.28) 
If a = sin? (0) with 0 € [0,3], then Equation (3.7.28) has the closed-form 
solution 
афі = sin? (2"+1g), n=0,1,..., (3.7.29) 
то = sin“ (0), with 0 € (0, |: 
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3.8 DISCRETE DYNAMICAL SYSTEMS AND 
CHAOS 


A dynamical system described by a function f : M — M is chaotic if 


1. f is transitive—that is, for any pair of non-empty open sets U and V in M 
there exists a positive constant k such that f*(U) N V is not empty (here 


fi =fofo---o f), and 


times 
2. The pond points of f are dense in M ; and 
3. f has a sensitive dependence on initial conditions—that is, there is a positive 
number ó (depending only on f and M) such that in every non-empty open 
subset of M there is a pair of points whose eventual iterates under f are sepa- 
rated by a distance of at least б. 


Some systems depend on a parameter and become chaotic for some values of that 
parameter. There are various routes to chaos, one of them is via period doubling 
bifurcations. 

Let the distance between successive bifurcations of a process be d. The limiting 
ratio ô = lim, 360 dk /dkķ+1 is constant in many situations and is equal to Feigen- 
baum's constant ó zz 4.6692016091029. 


3.81 CHAOTIC ONE-DIMENSIONAL MAPS 
1. Logistic map: z4441 = 41,(1 — £n) with zo € [0,1]. 


1 1 
Solution 18 £n = 2-25 cos[2" cos“ (1 — 220)]. 


2. Tent map: 2,41-1-2 |En — i| with zo € [0,1]. 
1 
Solution is x, = — соз ![cos(2"T.r9))]. 
T 
3. Baker transformation: 2,41 = 2a, (mod 1) with xo € [0,1]. 


1 
Solution is т, = — cot![cot(2"Tz9)]. 
T 


3.8.2 LOGISTIC MAP 


Consider un. +1 = (иһ) = aun(l — un) with a € [0,4]. Note that if O < uo < 1 
then 0 < u, < 1. The x ed points satisfy u = f(u) = au(1 — и); they are u = 0 
and u = (a — 1)/a. 


. Ifa = 0 then u,, = 0. 

„N10<a< 1 ћепи, > 0. 

„11<a< 3 ћепи, — (a — 1) /а. 

. If3 < a < 3.449... then un oscillates between the two roots of u = f(f(u)) 
which аге not roots of u = f(u), that is, u+ = (a +1 + Va? — 2a — 3) /2a. 


+ V VH 
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The location of the nal state is summarized by the following diagram (the horizontal 
axis 1s the a value). 


ат. 


0 "i 1 | ‚ | | 
0 0.5 1 15 2 2.5 3 3.5 


7" ponis in a cycle 
2 3 


3.449490... 
3.544090... 
3.564407... 
3.568750... 
3.56969... 
3.56989... 
3.569934... 
3.569943... 
3.5699451... 
3.569945557... 


em 


2 
3 
4 
9 
6 
T 
8 
9 
0 
1 


кі -- 


3.8.3 JULIA SETS AND THE MANDELBROT SET 


For the function f(x) = 2? + c consider the iterates of all complex points 2, 2541 = 
f(zn) with zo = z. For each z, either the iterates remain bounded (z is in the 
prisoner set) or they escape to in nity (z is in the escape set). The Julia set J, is the 
boundary between these two sets. Using lighter colors to indicate a “faster” escape 
to in nity , Figure 3.6 shows two Julia sets. One of these Julia sets is connected, the 
other is disconnected. The Mandelbrot set, M, is the set of those complex values 
c for which J, is a connected set (see Figure 3.7). Alternately, the Mandelbrot set 
consists of all points c for which the discrete dynamical system, 2,41 = 22 + c with 
20 = 0, converges. 

The boundary of the Mandelbrot set is a fractal. There is not universal agree- 
ment on the de nition of “fractal”. One de nition is that it is a set whose fractal 
dimension differs from its topological dimension. 
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FIGURE 3.6 
Connected Julia set for с = —0.51 (left). Disconnected Julia set for с = —3(1 + i) (right). 


(Julia sets are the black objects.) 


FIGURE 3.7 
The Mandelbrot set. The leftmost point has the coordinates (—2, 0). 


3.9 GAME THEORY 


3.9.1 TWO PERSON NON-COOPERATIVE MATRIX GAMES 


Matrix games idealize situations with participants having different goals. Given ma- 
trices A = (a;,;) and B = (b; j) consider a game played as follows. After Al- 
ice chooses action 2 (one choice out of n possible actions) and simultaneously Bob 
chooses action 7 (one choice out of m possible actions) Alice and Bob receive a 
payoff of a;,; and b, j, respectively. De ne (i, 7) as the outcome of the game. If the 
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players have а mixed or random strategy then Alice selects x" = (£1, £2,..., £n) 
where x; corresponds to the probability that she chooses action % and Bob selects 
у! = (01,09,...,От) where уу corresponds to the probability that he chooses 
action j. Неге, the players seek to maximize their average payoff; that is, Alice 
wants to maximize x! Ay = W SP j 210,303 and Bob wants to maximize x! By = 
2,2. Tibi jys. 

If aj,; € ai» j for all ? and у then i is a dominant strategy for Alice. Similarly, if 
bij € bi, j» forall i and j then j* is a dominant strategy for Bob. An outcome (i, j*) 
is Pareto optimal if, for all i and j, the relation aj» j+ < aj,; implies bi» > bij. 

If A + B = 0 then the game is a zero sum game and Bob equivalently is trying 
to minimize Alice's payoff. If A+ B Z 0 then the game is a non-zero sum game and 
there is potential for mutual gain or loss. 


3.9.1.1 The pure zero sum game 


For a zero sum game, А + B = 0. The outcome (2,2) is an equilibrium if а; € 
аҙ < аҙ; for all апа j. (Note that this implies b; < b;5 < b, 3.) 
1. If (7, j) is an equilibrium then max; min; aj; = minj max; aij = 473. 


2. For all A, max; шіп; а; j < minj max; a) j. 


3. For some А, there is no equilibrium. For example, if A = [17] 
then 1 = max, min; a; ; < min; max, а; = 2. 


4. For some A, there might be an equilibrium which is not a dominant strategy for 
a player. For example, if A = [3 1], then the outcome (1,1) is an equilibrium 
with the property that Alice has the dominant strategy ? = 148011 > a21 
and a1 2 > ахо, but there is no dominant strategy for Bob as аір < ау but 
аз > 02,3. 


5. For all A, all outcomes are Pareto optimal as а> < aij implies 


077 = 2477 > tij = bi. 


6. For a given A, there can be multiple equilibria. If (i, 71) and (i2, j2) are each 
an equilibrium then алд = àj,,j, = Gi, ,jo = а, and (i1, j2) and (i2, j1) 
1 | then the outcomes (1,1), (1,3), 


are also eguilibria. For example, if A — | 1 


(3,1) and (3,3) are each an eguilibrium. 


7. Order of actions: If Alice chooses her action before Bob (or commits to an ac- 
tion rst) and she chooses i then Bob will choose action? 8(@) = arg min; a; ;. 
Hence Alice will choose 2 = аге тах; а; вз) = аг шах, min; а; у which is 
said to be the maximin strategy. Alternatively, if Bob chooses his action before 
Alice he will choose the minimax strategy j = argmin; max; а). A player 
should never prefer to choose an action rst, but if there is an equilibrium, the 
advantage of taking the second action can be eliminated. 


The “arg” function refers to the index. 
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3.9.1.2 The mixed zero sum game 


The outcome (X, y) is an equilibrium for the mixed zero sum game if 


x! Ay < x" Ay < X. Ay 


for all x € 5, and all y € S, 


where 5, = (x | 0 < z; and У, a; = 1} and Sy = {y | 0 < y; and У, y; = 1). 


1. If (X, y) is an equilibrium then 


max min x! Ay = min maxx! Ay = x T Ay. 


x€ $, y€ S, 


yeS, Xe S. 


2. For all A, there exists at least one mixed strategy equilibrium. If there is 


more than one equilibrium, the average payoff to each player is independent 
of which equilibrium is used. 


. If ming), ti ға) < min; 22,244, for all x € 5, and шах, уу; а, jYj 
max; уу 4i,;9; for all y € S, then (©, y) is an equilibrium. 


[V 


. If A > 0 then an equilibrium strategy for Alice solves max, v subject to v < 
Уз; tiai j for all j, with У, z; = 1, and z; > 0. Here, the optimal value of 
v will correspond to the average payoff to Alice in equilibrium. If z; = x;/v 
this is equivalent to solving 


галај > 1, forallj, 
minimize Уа subject to 220, > 7 
i | т! >0, foralli. 


1 


Similarly, if y' = (yj,..., Yh) is a solution to 


азу. <1, foralli 
maximize wi subject to Уа yj hace a 
7 y; 20, forallj, 
then y = у'/ 5^; y; is the equilibrium strategy for Bob. The payoff to Alice 
in equilibrium is v = 1/ У, 2; = 1/7; yj. These optimization problems аге 
an example of linear programming (see page 280). 


For example, if A = [12] then the solution to 


а) +2205 1, x, 0, 


хасан А 
maximize 21 + 25 subject to 
diss d оо x > 0 


01201213 
is (21,22) = (5, 


so the payoff to Alice in equilibrium is 5 > and the eguilibrium 
3). 
2 


5. If A is 2 x 2 and 1,1 < 41,2, 01,1 < 021, 02,2 < 021, and 02.2 < 412 (so 


neither player has a dominant strategy) then the mixed strategy equilibrium is 


2 42,1 — 42,2 01,2 — 411 
x zs 3 7 
a1,2 + 42,1 —411 — 42,2 01,2 + аз — Q1,1 — 02,2 


(3.9.1) 

2 01,2 — 02,2 02.1 — 41,1 

1551-22-00: EN сз TE RT 
a1,2 + 424 — 41,1 — 42,2 G12 +31 —41,1 — 02,2 
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and the payoff to Alice in equilibrium is 


max min > 2 Фа) = шіп max > : 2104.303 


х65, YESy У65, Х65, 
(3.9.2) 
01,242,1 — р РӨ 
01,2 + 42, — а11 — 49,2 
For example, if A = [3 2] then the solution is X = y = (4, 2) and the payoff 


to Alice in equilibrium is 3, 


. Order of actions: It is never an advantage to take the rst action. However, if 


the rst player uses a mixed strategy equilibrium then the advantages of taking 
the second action can always be eliminated. 


3.9.1.3 The non-zero sum game 
The outcome (i,j) is a Nash equilibrium if a, j € а> for all i and 5; < 5- 


2,2 


for all j. For the mixed strategy ше the outcome (X, y) is a Nash equilibrium if 
x’ Ay <x T Ay for all x € S, and X. Ay <x T Ay for all y € Sy. 


1. 
2. 


For all A and В, there exists at least one mixed strategy Nash equilibrium. 


For all A and B, max; Ж аыйр < > 255 2404,9) and шах, 97,7%; < 
32:35) Tibi Új is а necessary and suf cient condition for (х,у) to bea n 
equilibrium. For example, if A = [11] and B = [7 1] then there are three 
Nash equilibra: (i) (x = (0, 1), y = (0, "D, (ii) (x = (4; 2,У- = (2, ЭГ апа 
(i) ($ = (1,0),9 = (1,0)}. 


‚ For all А and B, if 224 a; jj; is a constant for all i and У, Zib; j is a constant 


for all j (i.e., each player chooses an action to make the other indifferent to 
their action) then (X, y) is a Nash equilibrium. 


. For some A and B if (i1, jı) and (i2, j2) are each a (pure strategy) Nash equi- 


librium then, unlike the case for a zero sum game, a;i, j, need not equal aj, ja» 
бийд need not equal bi, ja, and neither (i1, j2) nor (i2, j1) need be a Nash 
equilibrium. For example, if A = [11] and B = [7 1] then both of the out- 
comes (1,1) and (2,2) are Nash equilibria yet a11 A аз 2, 01,1 Æ бор and 
neither (1,2) nor (2,1) is a Nash equilibrium. 


. Prisoners’ Dilemma: A game in which there is a dominant strategy for both 


players but it is not Pareto optimal. For example, if A = [19 2] and В = 
[19 12] then the dominant (and equilibrium) outcome is (2,2) since a», > a1, 
for all j and b, > > bj; for all i. Here, Alice and Bob receive a payoff of 5 
although the outcome (1,1) would be preferred by both because each would 
receive a payoff of 10. The name is derived from the possibility that the poten- 
tial jail sentence for two people accused of a joint crime could be constructed 
to create a dominant strategy for both to choose to confess to the crime, yet 
both would serve less jail time if neither confesses. 
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б. 


Braess Paradox: A game in which the Nash equilibrium has a worse payoff for 


all players than the Nash equilibrium which would result if there were fewer 


Р : А 10 2 1 10 15 20 
possible actions. For example, if A = 15 5 | and B — 2 5 | Шеп 


the Nash equilibrium is (3,3) which is worse for both players than the Nash 
equilibrium (2,2) which would occur if the third option for each player was 
unavailable. This paradox was originally constructed to demonstrate that the 
equilibrium distribution of o ws in a trafc network would be preferred by 
everyone if a traf c link, e.g., a bridge, weren't there. 


. Order of actions: If Alice chooses action 7 before Bob chooses an action 


then Bob will choose 6(i) = argmax/b, j and hence Alice will choose 


ж 


1 = arg тах; aj, 8(%)- Alternatively, if Bob chooses an action before Alice, 
he will choose j = arg max; ба()),; Where a(j) = arg max; a;,;. Unlike the 
zero sum game there might be an advantage to choosing the action rst, e.g., 
for A = [13] and B = [} 1] if Alice is rst the outcome will be (1,1) with a 
payoff of 4 to Alice and 3 to Bob. If Bob is rst the outcome will be (2,2) with 
a payoff of 4 to Bob and 3 to Alice. 


3.9.2 VOTING POWER 


Matrix games implicitly exclude the possibility of binding agreements among the 
players to resolve their differing goals. When such agreement exist, it is sometimes 
possible to quantify the relative power of the players. 


3.9.2.1 Voting power de nitions 


A weighted voting game is represented by the vector [9; w1, w», ..., Wn]; this means: 


л > шого н 


. There are n players. 

. Player 2 has ш; votes (with ш; > 0). 

. A coalition is a subset of players. 

. A coalition S is winning if >“: s Wi > g, where g is the quota. 
. A game is proper if 5 Vw < g. 


A player 


1. 
2. 
3. 


can have veto power: no coalition can win without this player 
is a dictator: has more votes than the guota 
is a dummy: cannot affect any coalitions 


3.9.2.2 Shapley-Shubik power index 


Consider all permutations of players. Scan each permutation from beginning to end; 
add together the votes that each player contributes. Eventually a total of at least g 
will be arrived at, this occurs at the pivotal player. The Shapley—Shubik power index 
(Ф) of player ? is the number of permutations for which player i is pivotal, divided 
by the total number of permutations. 
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EXAMPLE 


1. Consider the [5; 4, 2, 1, 1] game; the players аге {A,B,C,D}. 


2. For the 4! = 24 permutations of four players the pivotal player is underlined: 


ABCD 
ABDC 
ACBD 
ACDB 
ADBC 
ADCB 


BACD 
BADC 
BCAD 
BCDA 
BDAC 
BDCA 


CABD 
CADB 
CBAD 
CBDA 
CDAB 
CDBA 


3. Hence player A has power Ф(А) = 18 = 0.75. 
4. The other three players have equal power of л x 0.083. 


3.9.2.3 Banzhaf power index 


Consider all 2“ possible coalitions of players. For each coalition, if player i can 
change the winningness of the coalition, by either entering it or leaving it, then 2 is 
marginal ог swing. The Banzhaf power index (В) of player 1 is proportional to the 
number of times he is marginal; the total power of all players is 1. 


EXAMPLE 


DABC 
DACB 
DBAC 
DBCA 
DCAB 
DCBA 


1. Consider the [5; 4, 2, 1, 1] game; the players are {A,B,C,D}. 
2. There аге 16 subsets of four players; each player is “in” (I) or is “ош” (0) of a coalition. 
For each coalition the marginal players are listed (in total there are 20 marginal players). 


0000 
0001 
0010 
0011 
0100 
0101 
0110 
OIII 


уу ууу уу 


U 

{А} 
{А} 
{А} 
{А} 
{А} 
{А} 
{А} 


3. Player A is marginal 14 times, and has power 3(A) 


3.9.2.4 Voting power examples 
1. For the game |51; 49, 48, 3] the winning coalitions are: {1,2,3}, {1,2}, {1, 3}, 
and {2,3}. These are the same winning coalitions as the game [3; 1, 1, 1]. 
Hence, all players have equal power by either index, even though the number 

of votes each player has is different. 


1000 
1001 
1010 
1011 
1100 
1101 
1110 
1111 


уу ууу уу 


LR 


4. The players B, C, and D are each marginal 2 times and have equal power of = = 0.1. 


Ів.с.р) 
{A.D} 
{A.C} 
{A} 
{A,B} 
{A} 
{A} 
{A} 


2. The original EEC (1958) had France, Germany, Italy, Belgium, The Nether- 
lands, and Luxembourg. They voted as [12; 4, 4, 4, 2, 2, 1]. Therefore: 


1 1 
$ = 75.14, 14,14,9,9,0) and 6 = —(5,5,5,3,3,0). (3.93) 


60 
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3. The UN security council has 15 members. The ve permanent members have 
veto power. For a motion to pass, it must be supported by at least 9 mem- 
bers of the council and it must not be vetoed. A game representation is: 
[39:7,7,7,7,7,1,1,1,1,1,1,1,1,1,1]. 

o n aa 


5 members 10 members 
: : — 421 uu 
(a) Shapley-Shubik powers: of each permanent member © major = 5115 © 
0.196, of each minor member © minor = ST x 0.002. 
(b) Banzhaf powers: Bmajor = 206 ~ 0.167 and minor = re © 0.017. 


4. Changing the quota in a game may change the powers of the players: 
(a) For [6; 4, 3,2] have ф = 24 1,1). 
(b) For [7; 4, 3,2] have © = #1, 1,0). 
(c) For [8; 4, 3,2] have © = 5 (1,1, 1). 


5. For the n-player game [g; a, 1, 1, 1, 1,..., 1] with 1 < a € g € n we nd 
Pmajor = а/п апа minor = (n a a)/n(n = 1). 


6. Four-person committee, one member is chair. Use majority rule until dead- 
lock, then chair decides. This is a [3; 2, 1, 1, | game so that © = + (3, 1,1,1). 


7. Five-person committee, with two co-chairs. Need a majority, and at least one 
co-chair. This is a [7: 3, 3,2, 2,2] game so that © = 5 3,3, 2,2,2) and 8 = 
ag (7. 7, 5,5, 5). 


8. For the game [7; 5, 3,3, 1] the powers are  — 8 = 15(5,3,3, 1). 


3.10 OPERATIONS RESEARCH 


Operations research integrates mathematical modeling and analysis with engineering 
in an effort to design and control systems. 


3.10.1 LINEAR PROGRAMMING 


Linear programming (LP) is a technique for modeling problems with linear objective 
functions and linear constraints. The standard form for an LP model with n decision 
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variables and m resource constraints is 


Minimize 5 ст) (objective function), 
7-1 
z; 20 гу =1,:--,n,  (non-negativity requirement), 
Subject to : . | 
) > ауу = bj fori—1,:-- ,m, (constraint functions), 
j=l 


(3.10.1) 


where x j is the amount of decision variable j used, c; is decision j's per unit contri- 
bution to the objective, a;; is decision j's per unit usage of resource i, and b, is the 
total amount of resource 2 to be used. 

Let x represent the (n x 1) vector (z1,22,::: , £n)", с the (n x 1) vector 
(c1,Ca,: ++ Cn)", b the (m x 1) vector (61,05, ++ ,bm)!, A the (m x n) matrix 
(aij), and А.; the (n x 1) column of A associated with z ,. Then the standard model, 
written in matrix notation, is “minimize сТх subject to Ax = b and x > 0”. A vector 
x is called feasible if, and only if, Ax = b andx > 0. 


3.10.1.1 Modeling in LP 


LP is an appropriate modeling technique if the following four assumptions are satis- 
ed by the situation: 


1. All data coef cients are known with certainty. 

2. There is a single objective. 

3. The problem relationships are linear functions of the decisions. 
4. The decisions can take on continuous values. 


Branches of optimization such as stochastic programming, multi-objective program- 
ming, non-linear programming, and integer programming have developed in opera- 
tions research to allow a richer variety of models and solution techniques for situa- 
tions where the assumptions required for LP are inappropriate. 


1. Product mix problem — Consider a company that has three products to sell. 
Each product requires four operations and the per unit data are given in the 
following table: 


т Assembly ss нэ 


5 
Ей 


E 


Let ra, ĽB, and тс represent the number of units of А, B, and C manufac- 
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tured daily. A model to maximize profit subject to the labor restrictions is 


Maximize 45x4 + 9027p + 55xc (total profit), 
214 + 315b + 2хс < 480 (drilling hours), 
314 + бхв + 1хс < 960 (assembly hours), 
Subject to: lza + 22в + Атс < 540 (finishing hours), 
21x4 +415 + lrc < 320 (packing hours), 
2420, тв >0, 120. 
(3.10.2) 


2. Maximum flow through a network — Consider the directed network in Fig- 
ure 3.8. Node S is the source node and node T is the terminal node. On 
each arc shipping material up to the arc capacity С;; is permitted. Material is 
neither created nor destroyed at nodes other than S and Т. The goal is to max- 
imize the amount of material that can be shipped through the network from 
S to T. Letting туу represent the amount of material shipped from node 7 to 
node 7, a model that determines the maximum flow is shown below. 


FIGURE 3.8 


Directed network modeling a flow problem. 
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Maximize rjr + zaT + “aT, 
251 = 313 + 214 + x17 (node 1 conservation), 
259 = X23 + T24 (node 2 conservation), 
: : (3.10.3) 
Subject to 213 + T23 = 23Т (node 3 conservation), 
254 + £24 + $14 = Tar (node 4 conservation), 


0 < zij < С forall pairs (i,j) (arc capacity). 


3.10.1.2 Transformation to standard form 


Any LP model can be transformed to standard form as follows: 
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Original model Standard form 
change “maximize objective" 
multiply c; by —1 


change “<” constraint to “=” constraint 


n 
add slack variable(s) to Ж ait; < bi 
j=1 


n 
(for example: 5 аа + Si = bi.) 
j=1 


change “>” constraint to “=” constraint 


n 
subtract surplus variable(s) from 5 Qij£j > bi 
j=1 


n 
(for example: 5 ajjzj — U, = bi) 


1-1 


LP requires that the slack and surplus variables are non-negative; therefore, deci- 
sions are feasible to the new constraint if, and only if, they are feasible to the original 
constraint. All slack and surplus variables have c; = 0. 


3.10.1.3 Solving LP models: simplex method 


Assume that there is at least one feasible x vector, and that A has rank m. Geo- 
metrically, because all constraints are linear, the set of feasible x forms a convex 
polyhedral set (bounded or unbounded) that must have at least one extreme point. 
The motivation for the simplex method for solving LP models is the following: 


For any LP model with a bounded optimal solution, an optimal solution 
exists at an extreme point of the feasible set. 


Given a feasible solution x, let x? be the components of x with x j > Oand x 
be the components with z; — 0. Associated with xP, dene B as the columns of A 
associated with each x; in xP. For example, if 22, z4, and Sı are positive in x, then 
xP = (z5,4,94)1, and B is the matrix with columns A .2, A.4, A.s,. Dene N as 
the remaining columns of A, i.e., those associated with х“. A basic feasible solution 
(BFS) is a feasible solution where the columns of B are linearly independent. The 
following theorem relates a BFS with extreme points: 


A feasible solution x is at an extreme point of the feasible region if, and 
only if, x is a BFS. 


The following simplex method nds an optimal solution to the LP by ndin g the 
optimal partition of x into xP and x": 


Step (1) Find an initial basic feasible solution. De ne xP, xY, B, №, cP, and c as 
above. 
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Step (2) Compute the vector c! = (c — eP BIN). If c; > 0 for all j, then 
stop; the solution x? = B~'b is optimal with objective value c? B~'b. 
Otherwise, select the variable т; in x with the most negative C value, 
and go to Step (3). 


Step (3) Compute Al, = Bo Ag. If A'; < 0 for all j, then stop; the problem 
is unbounded and the objective can decrease to —oo. Otherwise, compute 
Uu 

b = B-!b and nd иш —-. Assume the minimum ratio occurs in 
ila, 20 Q;; 
row r. Insert x j into the r“ position of xP, take the variable that was in this 
position, and move it to x“. Update B, №, cP, and с^ accordingly. Return 

to Step (2). 


Ties in the selections in Steps (2) and (3) can be broken arbitrarily. The unbound- 
edness signal suggests that the model is missing constraints or that there has been an 
incorrect data entry or computational error, because, in real problems, the pro t or 
cost cannot be unbounded. For maximization problems, only Step (2) changes. The 
solution is optimal when с; < 0 for all 7, then choose the variable with the maximum 
с; value to move into xP. Effective methods for updating В”! in each iteration of 
Step (3) exist to ease the computational burden. 

To nd an initial basic feasible solution de ne а variable А; and add this variable 
to the left hand side of constraint 7 transforming to 2314 aij + А; = bi. The new 
constraint is equivalent to the original constraint if, and only if, А; = 0. Also, 
because A; appears only in constraint 7 and there are m A, variables, the columns 
corresponding to the A; variables are of rank m. We now solve a “new” LP model 
with the adjusted constraints and the new objective “minimize Ук А”. If the 
optimal solution to this new model is 0, the solution is a basic feasible solution to the 
original problem and we can use 1t in step (1). Otherwise, no basic feasible solution 
exists for the original problem. 


3.10.1.4 Solving LP models: interior point method 


An alternative method to investigating extreme points is to cut through the middle 
of the polyhedron and go directly towards the optimal solution. Extreme points, 
however, provide an ef cient method of determining movement directions (Step (1) 
of simplex method) and movement distances (Step (2) of simplex method). There 
were no effective methods on the interior of the feasible set until Karmarkar’s method 
was developed in 1984. The method assumes that the model has the following form: 
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n 
Minimize > ст), 


j=l 
n 
X aig; -0 fori = 1, „m, 
JA (3.10.4) 
Subject to á 
2,4% -і, 
7-1 
x; 20, forj = 1,::: „п. 
Also, assume that the optimal objective value is 0 and that x; = 1/n for j = 


1,--+ ,n is feasible. Any model can be transformed so that these assumptions hold. 
The following centering transformation, relative to the k“) estimate of solution 
vector x^, takes any feasible solution vector x and transforms it to y such that the 
k 
TE 7 
n 
vrai (11/1) 
Diag(z*) represent an n х n matrix with off-diagonal entries equal to 0 and the 
diagonal entry in row j egual to x 15 The formal algorithm is as follows: 


x^ is transformed to the center of the feasible simplex: y j^ . Let 


Step (1) Initialize x} = 1/n and set the iteration count k = 0. 


n 
Step (2) If Ж m cj is suf ciently close to 0, then stop; x* is optimal. Otherwise go 


j—1 
to Step (3). 
Step (3) Move from the center of the transformed space in an improving direction 
using 
T = 3 
ЕТТЕ E AN 1 80 = P (PPT)-! P)[Diag(x* Je" 
nn m ІС nm — 1) 


where ||C; || is the length of the vector (I — PT (PPT)-! P)[Diag(x*)]c? , 
P is an (m + 1) x n matrix whose rst m rows are A[Diag(x*)] and whose 
last row is a vector of 1's, and 9 is a parameter that must be between 0 
and 1. Go to Step (4). 


Step (4) Find the new point x“+! in the original space by applying the inverse trans- 


formation of the centering transformation to y ^*!. Set k = Ё-Е1 and return 
to Step (2). 


The method is guaranteed to converge to the optimal solution when 0 — i is used. 


3.10.2 DUALITY AND COMPLEMENTARY SLACKNESS 


De ne yj as the dual variable (shadow price) representing the purchase price for а 
unit of resource 2. The dual problem to the primal model (maximize objective, all 
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constraints of the form “<”’) is 
m 
Minimize >; biyi, 
i=1 


m 
: аа 256) forj =1,...,n, 
Subject to PE 


(3.10.5) 


yi 2.0, fori =1,...,m. 


The objective minimizes the amount of money spent to obtain the resources. 
The constraints ensure that the marginal cost of the resources is greater than or equal 
to the marginal pro t for each product. 

The following results link the dual model (minimization) with its primal model 
(maximization). 


1. Weak duality theorem: Assume that x and y are feasible solutions to the re- 
spective primal and dual problems. Then 


n m 
> ty € Y bi 
j=l ігі 


2. Strong duality theorem: Assume that the primal model has a nite optimal 
solution x“. Then the dual has a nite optimal solution y*, and 


n m 
шү сын bat 
сут) = ili- 

j=l 1-1 


3. Complementary slackness theorem: Assume that x and y are feasible solutions 
to the respective primal and dual problems. Then, x is optimal for the primal 
and y is optimal for the dual if and only if: 


Vi“ bi — X айт) = 0, fori =1,---,m, and 
=! (3.10.6) 
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3.10.3 LINEAR INTEGER PROGRAMMING 


Linear integer programming models result from restricting the decisions in linear 
programming models to be integer valued. The standard form is 


n 
Minimize 8 Cjt (objective function), 
j=l 
220, and integer for j = 1,...,n, (3.10.7) 
Subject t ” . 
ШУЛ »» Qij£j = b, fori =1,...,m (constraint functions). 
j=l 


As long as the variable values are bounded, then the general model can be trans- 
formed into a model where all variable values are restricted to either 0 or 1. There- 
fore, algorithms that can solve 0—1 integer programming models are suf cient for 
most applications. 


3.10.4 BRANCH AND BOUND 


Branch and bound implicitly enumerates all feasible integer solutions to па the 
optimal solution. The main idea is to break the feasible set into subsets (branching) 
and then evaluate the best solution in each subset or determine that the subset cannot 
contain the optimal solution (bounding). When a subset is evaluated, it is said to 
be fathomed. The following algorithm performs the branching by partitioning on 
variables with fractional values and uses a linear programming relaxation to generate 
a bound on the best solution in a subset: 


Step (1) Assume that a feasible integer solution, called the incumbent, is known 
whose objective function value is z (initially, z may be set to in nity if no 
feasible solution is known). Set р, the subset counter, equal to 1. Set the 
original model as the rst problem in the subset list. 


Step (2) If p = 0, then stop. The incumbent solution is the optimal solution. Other- 
wise go to Step (3). 


Step (3) Solve the LP relaxation of the p" problem in the subset list (allow all integer 
valued variables to take on continuous values). Denote the LP objective 
value by v. If v > z or the LP is infeasible, then set p = p — 1 (fathom by 
bound or infeasibility), and return to Step (2). If the LP solution is integer 
valued, then update the incumbent to the LP solution, set z = min(z,v) 
and p = p — 1, and return to Step (2). Otherwise, go to Step (4). 


Step (4) Take any variable z ; with fractional value in the LP solution. Replace prob- 
lem p with two problems created by individually adding the constraints 
x; € |v;| and x; > (ғ | to problem p. Add these two problems to the 
bottom of the subset list replacing the р" problem, set p = p + 1, and go to 
Step (2). 
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3.10.5 NETWORK FLOW METHODS 


A network consists of N, the set of nodes, and A, the set of arcs. Each arc (7,7) 
de nes a connection from node 7 to node 7. Depending on the application, arc (2, j) 
may have an associated cost and upper and lower capacity on о w. 

Decision problems on networks can often be modeled using linear programming 
models, and these models usually have the property that solutions from the simplex 
method are integer valued (the total unimodularity property). Because of the under- 
lying graphical structure, more ef cient algorithms are also available. We present 
the augmenting path algorithm for the maximum о w problem and the Hungarian 
method for the assignment problem. 


3.10.5.1 Maximum ow 


Let xi, represent the o w on arc (i, j), cij the o w capacity of (i, j), S be the source 
node, and T be the terminal node. The maximum o w problem is to ship as much 
o w from S to T without violating the capacity on any arc, and all o w sent into 
node i must leave i (for i # 5, Т). The following algorithm solves the problem by 
continually adding o w-carrying paths until no path can be found: 


Step (1) Initialize z;; = 0 for all (i, j). 


Step (2) Find а o w-augmenting path from 5 to T' using the following labeling 
method. Start by labeling S with a“. From any labeled node i, label node 
j with the label 4 if j is unlabeled and x;; < су; (forward labeling arc). 
From any labeled node 1, label node 7 with the label ? if j is unlabeled 
апат; > 0 (backward labeling arc). Perform labeling until no additional 
nodes can be labeled. If T' cannot be labeled, then stop. The current z ;; 
values are optimal. Otherwise, go to Step (3). 


Step (3) There is a path from S to T' where o w is increased on the forward labeling 
arcs, decreased on the backward labeling arcs, and gets more o w from S 
to T. Let Р be the minimum of cj; — xij over all forward labeling arcs and 
of а; over all backward labeling arcs. Set z;; = 24) + F for the forward 
arcs and zij = zij — F for the backward arcs. Return to Step (2). 


The algorithm terminates with a set of arcs with z;; = cj; and if these are 
deleted, then S and Т are in two disconnected pieces of the network. The algorithm 
nds the maximum o w by nding the minimum capacity set of arcs that disconnects 
5 and T' (minimum capacity cutset). 


3.10.6 ASSIGNMENT PROBLEM 


Consider a set J of jobs and a set J of employees. Each employee can do 1 job, and 
each job must be done by 1 employee. If job 7 is assigned to employee i, then the 
cost to the company is c;;. The problem is to assign employees to jobs to minimize 
the overall cost. 
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This problem can be formulated as an optimization problem on a bipartite graph 
where the jobs are one part and the employees are the other. Let m be the cardinality 
of J and 1 (they must be equal cardinality sets, otherwise there is no feasible solu- 
tion), and let C be the m x m matrix of costs cij. The following algorithm solves 
for the optimal assignment. 


Step (1) Find l; = min су; for each row 2. Let cj; = cij — li. Find n; = min с;з for 
J 1 
each column j. Let cij = cj; — nj. 


Step (2) Construct a graph with nodes for 5, Т, and each element of the sets J 
and Т. Construct an arc from S to each node in 7, and set its capacity to 1. 
Construct an arc from each node in J to Т, and set its capacity to 1. If 
сіз = 0, then construct an arc from i € 7 to j € J, and set its capacity 
to 2. Solve a maximum о w problem on the constructed graph. If m units 
of o wcan go through the network, then stop. The maximum о w solution 
on the arcs between J and J represents the optimal assignment. Otherwise, 
go to Step (3). 


Step (3) Update С using the following rules based on the labels in the solution to 
the maximum о w problem: Let Гг and Ly be the set of elements of J and 
J respectively with labels when the maximum o w algorithm terminates. 


Let ô = min су; note that 6 > 0. Fori € Lr and j € (J — Lj), 
i€Lri,j€(J—L;) 


set cij = cj; — Ô. Fori € (I — Lr) andj € Ly, set ci; = cij + 6. Leave 
all other cj; values unchanged. Return to Step (2). 


In Step (3), the algorithm creates new arcs, eliminates some unused arcs, and 
leaves unchanged arcs with z;; — 1. When returning to Step (2), you can solve the 
next maximum о w problem by adding and deleting the appropriate arcs and starting 
with the o ws and labels of the preceding execution of the maximum o w algorithm. 


3.10.7 DYNAMIC PROGRAMMING 


Dynamic programming is a technique for determining a sequence of optimal deci- 
sions for a system or process that operates over time and requires successive de- 
pendent decisions. The following ve properties are required for using dynamic 
programming: 


1. The system can be characterized by a set of parameters called state variables. 

2. Ateach decision point or stage of the process, there is a choice of actions. 

3. Given the current state and the decision, it is possible to specify how the state 
will evolve before the next decision. 

4. Only the current state matters, not the path by which the system arrived at the 
state (termed time separability). 

5. An objective function depends on the state and the decisions made. 


The time separability requirement is necessary to formulate a functional form 
for the decision problem. Let f; (i) denote the optimal objective value to take the 
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system from stage ¢ to the end of the process, given that the process is now in state 
i, А, (2) is the set of decisions possible at stage ? and state i, а; is a particular action 
in A,(i), Aj (aj) is the change from state i between stage ¢ and stage t + 1 based 
on the action taken, and c;,(a;) is the immediate impact on the objective of taking 
action a; at stage ¢ and state 2. 

The principle of optimality states: 


An optimal sequence of decisions has the property that, whatever the 
initial state and initial decision are, the remaining decisions must be an 
optimal policy based on the state resulting from the initial information. 


Using the principle, Bellman’s equations are 


а;ЄА+(%) 


fii) = и ПТ m NE (i) = min fcx(aj) + fé [A (aj »). for all 4. 


3.10.8 SHORTEST PATH PROBLEM 


Consider a network (N, А) where N is the set of nodes, A the set of arcs, and 4;; 
represents the “distance” of traveling on arc (7,7) (if no arc exists between 7 and 
j, dij = oo). For any two nodes R and 5, the shortest path problem is to nd the 
shortest distance route through the network from R to S. Let the state space be N 
and a stage representing travel along one arc. f * (4) is the optimal distance from node 
i to S. The resultant recursive equations to solve are 


FPO =minldy ef. гай. 


Dijkstra"s algorithm can be used successively to approximate the solution to the 
equations when dj; > 0 for all (i, j). 


Step (1) Set fš(S) = 0 and f*(i) = dis for alli € N. Let P be the set of 
permanently labeled nodes; P — (S). Let T — N — P be the set of 
temporarily labeled nodes. 


Step (2) Find i € Т with f*(i) = ings (j). Set T = T — (i) and P = PU (i). 
JE 


If T = 0 (the empty set), hon stop; f*(R) is the optimal path length. 
Otherwise, go to Step (3). 


Step (3) Set f*(j) = min[f* (j), f" (1) + dij] for all е Т. Return to Step (2). 


3.10.9 HEURISTIC SEARCH TECHNIQUES 


Heuristic search techniques are commonly used in algorithms for combinatorial op- 
timization problems. The method starts with an initial vector x o and attempts to nd 
improved solutions. De ne x to be the current solution vector, f (x) to be its objective 
value, and N(x) to be its neighborhood. For the remainder of this section, assume 
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that we seek to nd the minimum value of f(x). In each iteration of a neighborhood 
search algorithm, we generate a number of solutions x" € N(x), and compare f(x) 
with each f(x’). If f(x’) is a better value than f(x), then we update the current 
solution to x’ (termed accepting x' ) and we iterate again searching from x'. The 
process continues until none of the generated neighbors of the current solution yield 
lower solutions. Common improvement procedures such as pairwise interchange 
and “k-opt” are speci c instances of neighborhood search methods. Note that at 
each iteration, we move to a better solution or we terminate with the best solution 
seen so far. 

The key issues involved in designing a neighborhood search method are the def- 
inition of the neighborhood of x, and the number of neighbors to generate in each 
iteration. When the neighborhood of x is easily computed and evaluated, then one 
can generate the entire neighborhood to ensure nding a better solution if one exists 
in the neighborhood. It is also possible to generate only a portion of the neighbor- 
hood (however, this could lead to premature termination with a poorer solution). In 
general, deterministic neighborhood search can only guarantee ndin g a local mini- 
mum solution to the optimization problem. One can make multiple runs, each with 
different initial solution vectors, to increase the chances of nding the global mini- 
mum solution. 


3.10.9.1 Simulated annealing (SA) 


Simulated annealing is neighborhood search method that uses randomization to avoid 

terminating at a locally optimal point. In each iteration of SA, we generate a single 

neighbor x’ of x. If f(x’) < f(x), then we accept x’. Otherwise, we accept x" with a 

probability that depends upon f(x“) — f(x), and a non-stationary control parameter. 
De ne the following notation: 


1. Cy is ће k“ control parameter, 

2. Lp is the maximum number of neighbors evaluated while the k" control pa- 
rameter is in use, and 

3. I, is the counter for the number of solutions currently evaluated at the k™ 
control parameter. 


To initialize the algorithm, we assume that we are given the sequences {С} (termed 
the cooling schedule) and {L ;} such that C > 0 as k — oo, and an initial value xo. 
The SA algorithm is (assuming that we are trying to minimize f(x)): 


Step (1) Set x = xo, k = 1 and J, = 0. 

Step (2) Generate a neighbor x’ of x, compute f(x’) and increment Г, by 1. 

Step (3) If f(x) < f(x), then replace x with x’ and go to Step (5). 

Step (4) If f(x“) > f(x), then with probability exp (4254) , replace x with x’. 


Step (5) If I} = Lp, then increment k by 1, reset J, = 0, and check for the termina- 
tion criterion. If the termination criterion is met, then stop, x is the solution; 
if not, then go to Step (2). 
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This SA description uses ап exponential form for the acceptance probability for 
inferior solutions, this was proposed by Metropolis et al. The algorithm terminates 
when С, approaches 0, or there has been no improvement in the solution over a 
number of С, values. In the above SA description we only store the current solution, 
not the best solution encountered. In practice, however, in Step (2), we also compare 
f(x) with an incumbent solution. If the incumbent solution is worse, then we replace 
the incumbent with х”, otherwise we retain the current incumbent. Note that SA only 
generates one neighbor of x in each iteration. However, we may not accept x" and 
therefore may generate another neighbor of x. 

Several issues related to parameter setting, neighborhood de nition , and solu- 
tion updating must be resolved when implementing SA. For example, the sequences 
of Съ and Lp values are critical for successful application. If С» goes to zero too 
quickly, then the algorithm can easily get stuck in a local minimum solution. If C 1 is 
large and С tends to zero too slowly, then the algorithm requires more computation 
to achieve convergence. To date, the majority of the analytical results and empirical 
studies in the SA literature consider the effects of the С; schedule, the Lg schedule, 
and the initial solution X9. The method can be shown to converge with probability 
one to the set of optimal solutions as long as С, — 0 as k — oo and У Су < oc. 


3.10.9.2 Tabu search 


Tabu search (TS) is similar to simulated annealing. A problem in SA is that one can 
start to climb out of a local minimum solution, only to return via a sequence of “bet- 
ter" solutions that leads directly back to where the algorithm has already searched. 
Also, the neighborhood structure may permit moving to extremely poor solutions 
where one knows that no optimal solutions exist. Finally, the modeler may have in- 
sight on where to look for good solutions and SA has no easy mechanism for enabling 
the search of speci c areas. Tabu search tries to remedy each of these de ciencies. 

The key terminology in TS is S (x), the set of moves from х. This is similar to the 
neighborhood of x, and is all the solutions that you can get to from x in one move. The 
terminology “move” is similar to the "step" in simulated annealing, but can be more 
general because it can be applied to both continuous and discrete variable problems. 
Let в be a move in S(x). For example, consider a 5-city traveling salesman problem 
where x is a vector containing the sequence of cities visited, including the return to 
the initial city. Let x = (2,1,5, 3,4,2). If we dene a move to be an “adjacent 
pairwise interchange”, then the set of moves S(x) is: 


1(1,2,5,3, 4, 1), (2, 5, 1,3, 4, 2), (2,1, 3,5, 4, 2), (2,1, 5, 4, 3,2), (4, 1,5,3,2, 4)} 


For another example, if we use a standard non-linear programming direction-step 
size search algorithm, then one can construct a family of moves of the form S(x) — 
x+ud. Here, u is a step size scalar and d is the direction of movement and the family 
depends on the values of u and d selected. 

To run the method, dene T as the tabu set. This is a set of moves that one 
does not want the method to use. Also, de ne ОРТ to be the function that selects a 
particular s € S(x) that creates an eventual improvement in the objective. Then 


Step (1) Find initial incumbent хо. Set x = x*, k = 0, T = 9. 
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Step (2) If S(x) — T = ф, then go to Step (4). Otherwise set k = k + 1 and select 
8, € S(x) — T such that s, (x) = OPT(s | s € S(x) — T). 


Step (3) Let x = s, (x). If f(x) < f(xo), then xo = x. 


Step (4) If a chosen number of iterations has elapsed either in total or since X g was 
last improved, or if S(x) — T = © from Step (2), then stop. Otherwise, 
update T (if necessary) and return to Step (2). 


The method is more effective if the user understands the solution space and can guide 
the search somewhat. Often the tabu list contains solutions that were previously 
visited or solutions that would reverse properties of good solutions. Early in the 
method, it is important that the search space is evaluated in a coarse manner so 
that one does not skip an area where the optimal solution is located. Management 
of the tabu list is also critical; the list will be expanding and contracting as you 
obtain more information about the solution space. The ability to solve the OPT 
problem quickly in Step (2) also helps the method by enabling the evaluation of 
more candidate solutions. Tabu search can move to inferior solutions temporarily 
when O PT returns a solution that has a worse objective value than f(x) and, in fact, 
this happens every time when x is a local minimum solution. For more details, see 
Glover. 


3.10.9.3 Genetic algorithms 


A different approach to heuristically solving dif cu It combinatorial optimization 
problems mimics evolutionary theory within an algorithmic process. A population of 
individuals is represented by K various feasible solutions x; fork — 1,..., K. The 
collection of such solutions at any iteration of a genetic algorithm is referred to as a 
generation, and the individual elements of each solution х ; are called chromosomes. 
For instance, in the context of the traveling salesman problem, a generation would 
consist of a set of traveling salesman tours, and the chromosomes of an individual 
solution would each represent a city. 

To continue drawing parallels with the evolutionary process, each iteration of 
a genetic algorithm creates a new generation by computing new solutions based on 
the previous population. More speci cally , an individual of the new generation is 
created from (usually two) parent solutions by means of a crossover operator. The 
crossover operator prescribes methodology by which a solution is created by com- 
bining characteristics of the parent solutions. The selection of the crossover operator 
is one of the most important aspects of designing an algorithm. 

The rules for composing a new generation differ among various implementa- 
tions, but often consist of selecting some of the best solutions from the previous 
generation along with some new solutions created by crossovers from the previous 
generation. Additionally, these solutions may mutate from generation to generation 
in order to introduce new elements and chromosomal patterns into the population. 
The objective value of each new solution in the new generation is computed, and the 
best solution found thus far in the algorithm is updated if applicable. The creation of 
the new generation of solutions concludes a genetic algorithm iteration. The algo- 
rithm stops once some termination criteria are reached (e.g., after a speci ed number 
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of generations are evolved, or perhaps if no new best solution was recorded in the 
last g generations). A typical genetic algorithm for minimization is: 


Step (1) Choose a population size К, a maximum number of generations Q, and a 
number of survivors S < K, where K, Q, and 5 are all integers. Also, 
choose some mutation probability р (typically, р is set to be a small value, 
often close to 0.05). Create some initial set of solutions x4, for k = 
1,..., K, and let Generation 0 consist of these solutions. Calculate the 
objective function of each solution in Generation 0, and let x* with objec- 
tive function f(x“) denote the best such solution. Initialize the generation 
counter 2 = 0. 


Step (2) Copy the best (according to objective function value) S solutions from Gen- 
eration i into Generation z + 1. 


Step (3) Create the remaining K — S solutions for Generation i + 1 by executing a 
crossover operation on randomly selected parents from Generation 7. For 
each new solution x; created, calculate its objective function value f(x). 


If f (xx) < f(x“), then set х" = x, and f(x“) = /(хь). 


Step (4) For k = 1,..., K, mutate solution x, in Generation 7 with probability p. 
Calculate the new objective function value f(x), and if f(x) < f(x), 
then set x“ = x, and f(x“) = f(x). 


Step (5) Seti = i + 1. If i = Q, then terminate with solution x“. Otherwise, return 
to Step 2. 


Genetic algorithm implementations differ because of the application area and 
the processes required by the algorithm. Three speci c processes required by genetic 
algorithms are discussed below. For more details, see Goldberg. 


1. Creating the initial population — Although often overlooked as an important 
part of executing genetic algorithms, careful consideration should be given to 
the creation of the initial set of solutions for Generation 0. For instance, we 
may employ a rudimentary constructive heuristic to generate a set of good 
initial solutions rather than using some blindly random approach. However, 
care must also be taken to ensure that the set of heuristic solutions generated 
is suf ciently diverse. That is, if all initial solutions are nearly identical, then 
the solutions created in the next generation may closely resemble those of the 
previous generation, thus limiting the scope of the genetic algorithm search 
space. Hence, one may penalize solutions having too close a resemblance to 
previously generated solutions in the initial step. 


2. The crossover process — The crossover operator is the most important consid- 
eration in designing a genetic algorithm. While the selection of the parents for 
the crossover operation is done randomly, preference should be given to parent 
solutions having better quality objective function values (imitating mating of 
the most t individuals, as in evolution theory). However, feasibility restric- 
tions are sometimes implied by the structure of a solution, and must therefore 
apply to the output of the crossover operator. 
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EXAMPLE For example, in the traveling salesman problem, one such feasibility 
restriction reguires that a solution must be a permutation of integers. Consider 
the following two parent solutions, where the return to the rst city is implied: 


(1,3,5,2,4,6) апа (1,2,3, 6,5,4). 


A crossover operator that simply takes the rst three chromosomes from the 
rst parent and the last three chromosomes from the last parent would result in 
the solution (1, 3, 5, 6, 5, 4), which is infeasible to the permutation restriction. 
An alternative operator might modify the foregoing operator with the follow- 
ing modi cation: post-process the solution by replacing repeated chromosomes 
with omitted chromosomes. In the prior example, city 5 is repeated while city 2 
is omitted, and thus one of the following two solutions would be generated: 


(1,3,2,6,5,4) or (1,3,5,6,2,4). 


3. The mutation operator — A common behavior of genetic algorithms executed 
without the mutation operator is that the solutions within the same generation 
converge to a small set of distinct solutions, from which radically different 
(and perhaps optimal) solutions cannot be created via the given crossover op- 
erator. The purpose of the mutation operator is to inject diverse elements into 
future iterations. Generally speaking, the mutation operator is often a small 
change within the solution, such as a pairwise interchange on a solution to the 
traveling salesman problem. However, the mutation operator must generate 
signi can t enough change in the solution to ensure that there exists a chance 
of having this modi cation propagate into solutions in future generations. 
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4.1 COORDINATE SYSTEMS IN THE PLANE 


4.1.1 CONVENTION 


When we talk about “the point with coordinates (r, y)" or “the curve with equation 
y = f(x)”, we always mean Cartesian coordinates. If a formula involves other 
coordinates, this fact will be stated explicitly. 


4.1.2. SUBSTITUTIONS AND TRANSFORMATIONS 


Formulae for changes in coordinate systems can lead to confusion because (for ex- 
ample) moving the coordinate axes up has the same effect on equations as moving 
objects down while the axes stay x ed. (To read the next paragraph, you can move 
your eyes down or slide the page up.) 

To avoid confusion, we will carefully distinguish between transformations of 
the plane and substitutions, as explained below. Similar considerations will apply to 
transformations and substitutions in three dimensions (Section 4.8). 


4.1.2.1 Substitutions 


A substitution, or change of coordinates, relates the coordinates of a point in one 
coordinate system to those of the same point in a different coordinate system. Usually 
one coordinate system has the superscript / and the other does not, and we write 


x = F,(2',y’), 2. 
ог (x,y) = F(x', y) (4.1.1) 
| — Ет ay), 
(where subscripts and primes are not derivatives, they are coordinates). This means: 
given the eguation of an object in the unprimed coordinate system, one obtains 
the eguation of the same object in the primed coordinate system by substituting 
Е, (2',у') for x and Р, (z', y") for y in the equation. For instance, suppose the primed 
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coordinate system 1s obtained from the unprimed system by moving the x axis up a 
distance d. Then x = 27 and y = y' + d. The circle with equations x? + y? = 1 in 
the unprimed system has equations x" e (y! + d = 1 in the primed system. Thus, 
transforming an implicit equation in (x, y) into one in (2', y") is immediate. 

The point P = (a,b) in the unprimed system, with equation x = a, y — b, 
has equation F;(z',y') = a, F,(z', y') = bin the new system. To get the primed 
coordinates explicitly, one must solve for x" and y’ (in the example just given we 
have z' = a, y' + d = b, which yields z' = a, y' = b — d). Therefore, if possible, 
we give the inverse equations 


П 
Per ое (aly!) = Gleg), 
y = Gy (x,y) 
which are equivalent to Equation (4.1.1) if G(F(x', y')) = (a', у”) and F(G(a, y)) = 
(2, у). Then to go from the unprimed to the primed system, one merely inserts the 
known values of x and y into these equations. This is also the best strategy when 
dealing with a curve expressed parametrically, that is, ж = x(t), y = y(t). 


4.1.2.2 Transformations 


A transformation associates with each point (x, y) a different point in the same co- 
ordinate system; we denote this by 


(ny) кэ F(x,y), (4.1.2) 


where F is a map from the plane to itself (a two-component function of two vari- 
ables). For example, translating down by a distance d is accomplished Бу (2, y) к> 
(x, y — d) (see Section 4.2). Thus, the action of the transformation on a point whose 
coordinates are known (or on a curve expressed parametrically) can be immediately 
computed. 

If, on the other hand, we have an object (say a curve) de ned implicitly by the 
equation C(z, y) = 0, nding the equation of the transformed object requires using 
the inverse transformation 


(x,y) > G(z,y) (4.1.3) 


de ned by G(F(z,y)) = (2,0) and F(G(x,y)) = (x,y). The equation of the 
transformed object is C(G(z, y)) = 0. For instance, if C is the circle with equation 
x? + y? = 1 and we are translating down by a distance d, the inverse transformation 
is (x,y) > (2, y + d) (translating up), and the equation of the translated circle is 
а? + (y + d? = 1. Compare to the example following Equation (4.1.1). 


4.1.2.3 Using transformations to change coordinates 


Usually, we will not give formulae of the form (4.1.1) for changes between two coor- 
dinate systems of the same type, because they can be immediately derived from the 
corresponding formulae (4.1.2) for transformations, which are given in Section 4.2. 
We give two examples for clarity. 
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FIGURE 4.1 


Change of coordinates by a rotation. 


Let the two Cartesian coordinate systems (x,y) and (x', y) be related as fol- 
lows: They have the same origin, and the positive x'-axis is obtained from the pos- 
itive z-axis by a (counterclockwise) rotation through an angle 0 (Figure 4.1). If a 
point has coordinates (x, y) in the unprimed system, its coordinates (zx, y) in the 
primed system are the same as the coordinates in the unprimed system of a point that 
undergoes the inverse rotation, that 15, a rotation by an angle a = —0. According to 
Equation (4.2.2) (page 305), this transformation acts as follows: 


cos@ віп0 
— 5110 cosé 


(x,y) > | | (x,y) = (rcos9+ysin9, —rsin0--ycos0). (4.1.4) 
Therefore the right-hand side of Equation (4.1.4) is (z', y’), and the desired substi- 


tution is 
1 = xcos9 + ysin$, 
, f (4.1.5) 
y = —вїп 0 + y cos. 
Switching the roles of the primed and unprimed systems we get the eguivalent 


substitution 
x = x cos0 — у sin, 
x | (4.1.6) 
y— x sin9 +y cos 
(because the x-axis is obtained from the x"-axis by a rotation through an angle —6). 
Similarly, let the two Cartesian coordinate systems (x,y) and (a', y') differ by 
а translation: x is parallel to x! and у to y’, and the origin of the second system 
coincides with the point (xo, yo) of the rst system. The coordinates (x,y) and 
(x', y^) of a point are related by 


1 + Фо, 2 = £ — 10, 


y — y + yo y =у— Yo. 


HH 
(4.1.7) 


4.1.3 CARTESIAN COORDINATES IN THE PLANE 


In Cartesian coordinates (or rectangular coordinates), the “address” of a point P is 
given by two real numbers indicating the positions of the perpendicular projections 
from the point to two x ed, perpendicular, graduated lines, called the axes. If one 
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coordinate is denoted x and the other y, the axes are called the x-axis and the y-axis, 
and we write P = (x,y). Usually the x-axis is horizontal, with x increasing to the 
right, and the y-axis is vertical, with y increasing vertically up. The point x = 0, 
y = 0, where the axes intersect, is the origin. See Figure 4.2. 


FIGURE 4.2 

In Cartesian coordinates, Р, = (4,3), P» = (—1.3,2.5), Рз = (—1.5, —1.5), Pa = 
(3.5, —1), and Р» = (4.5,0). The axes divide the plane into four quadrants. Р, is in the 
r st quadrant, P» in the second, Pz in the third, and P4 in the fourth. Ps is on the positive 
x-axis. 


Р, 


4.1.4 POLAR COORDINATES IN THE PLANE 


In polar coordinates a point P is also characterized by two numbers: the distance 
r > Отоа xed pole or origin O, and the angle 0 that the ray OP makes with a x ed 
ray originating at O, which is generally drawn pointing to the right (this is called the 
initial ray). The angle $ is de ned only up to a multiple of 360° or 27 radians. In 
addition, it is sometimes convenient to relax the condition r > 0 and allow r to be a 
signed distance; so (r, 0) and (-ғ, 9 + 180°) represent the same point (Figure 4.3). 


FIGURE 4.3 
Among the possible sets of polar coordinates for P are (10,30°), (10,390°) and 
(10, —330°). Among the sets of polar coordinates for Q are (2.5, 210°) and (—2.5, 30°). 
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4.1.4.1 Relations between Cartesian and polar coordinates 


Consider a system of polar coordinates and a system of Cartesian coordinates with 
the same origin. Assume that the initial ray of the polar coordinate system coincides 
with the positive x-axis, and that the ray 9 = 90° coincides with the positive y-axis. 
Then the polar coordinates (r,0) with r > 0 and the Cartesian coordinates (x, y) of 
the same point are related as follows (> and y are assumed positive when using the 
tan“! formula): 


: y 
5—5 sing = —————, 
z = 700890, duc d E уа” жу? 
y=rsing, 9 = tan“! Ў, cos = ———. 
x Г + y? 


4.1.5 HOMOGENEOUS COORDINATES IN THE PLANE 


A triple of real numbers (x : y : t), with t Z 0, is a set of homogeneous coordinates 
for the point P with Cartesian coordinates (z/t, y/t). Thus the same point has many 
sets of homogeneous coordinates: (x : y : t) and (x : y’ : ť) represent the same 
point if and only if there is some real number a such that x = oz, у = ay, z" = az. 

When we think of the same triple of numbers as the Cartesian coordinates of 
a point in three-dimensional space (page 345), we write it as (x, y,t) instead of 
(x : y : t). The connection between the point in space with Cartesian coordinates 
(x, y, t) and the point in the plane with homogeneous coordinates (x : y : t) becomes 
apparent when we consider the plane ¢ = 1 in space, with Cartesian coordinates 
given by the rst two coordinates x, у (Figure 4.4). The point (2, y, t) in space can 
be connected to the origin by a line L that intersects the plane £ = 1 in the point with 
Cartesian coordinates (x/t, y/t) or homogeneous coordinates (a : y : t). 

Homogeneous coordinates are useful for several reasons. One of the most im- 
portant is that they allow one to unify all symmetries of the plane (as well as other 
transformations) under a single umbrella. АП of these transformations can be re- 
garded as linear maps in the space of triples (x : y : t), and so can be expressed in 
terms of matrix multiplications (see page 306). 

If we consider triples (x : y : t) such that at least one of r,y,t is non-zero, 
we can name not only the points in the plane but also points “at in nity”. Thus, 
(z : y : 0) represents the point at in nity in the direction of the ray emanating from 
the origin going through the point (x, y). 


4.1.6 OBLIQUE COORDINATES IN THE PLANE 


The following generalization of Cartesian coordinates is sometimes useful. Consider 
two axes (graduated lines), intersecting at the origin but not necessarily perpendic- 
ularly. Let the angle between them be w. In this system of oblique coordinates, a 
point P is given by two real numbers indicating the positions of the projections from 
the point to each axis, in the direction of the other axis (see Figure 4.5). The rst 
axis (x-axis) is generally drawn horizontally. The case w = 90° yields a Cartesian 
coordinate system. 
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FIGURE 4.4 
The point Р with spatial coordinates (x, y, t) projects to the point Q with spatial coordinates 


(2/2, y/t, 1). The plane Cartesian coordinates of Q are (2 /t, y/t), and (л: y : t) is one set 
of homogeneous coordinates for Q. Any point on the line L (except for the origin O) would 


also project to Q. 


FIGURE 4.5 
In oblique coordinates, P, = (4, 3), P» = (—1.3,2.5), Рз = (—1.5, —1.5), Pa = (3.5, —1), 
and Ps = (4.5,0). Compare to Figure 4.2. 


4.1.6.1 Relations between two oblique coordinate systems 


Let the two oblique coordinate systems (x,y) and (x, y), with angles w and ш”, 
share the same origin, and suppose the positive z'-axis makes an angle 0 with the 
positive x-axis. The coordinates (2, y) and (x', y") of a point in the two systems аге 
related by 
x’ sin(w — 9) + y' sin(w — w' — 8) 
Шш-------------:---, 
| 22 (4.1.8) 
. a’ sind by sin(w + 8) 


sin w 
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This formula also covers passing from a Cartesian system to an obligue system and 
vice versa, by taking w = 90° or v = 90°. 

The relation between two oblique coordinate systems that differ by a translation 
is the same as for Cartesian systems. See Equation (4.1.7). 


4.2 PLANE SYMMETRIES OR ISOMETRIES 


A transformation of the plane (invertible map of the plane to itself) that preserves 
distances is called an isometry of the plane. Every isometry of the plane is of one of 
the following types: 


1. The identity (which leaves every point x ed) 

2. A translation by a vector у 

3. A rotation through an angle a around a point P 
4. Are ection ina line L 

5. A glide-re е ction in a line L with displacement d 


Although the identity is a particular case of a translation and a rotation, and re ec- 
tions are particular cases of glide-re ections, it is more intuitive to consider each 
case separately. 


4.2.1 FORMULAE FOR SYMMETRIES: CARTESIAN 
COORDINATES 


In the formulae below, a multiplication between a matrix and a pair of coordinates 
should be carried out regarding the pair as a column vector (or a matrix with two 
rows and one column). Thus [4%] (x,y) = (az + by, cx + dy). 


1. Translation by (xo, yo): 


2. Rotation through a (counterclockwise) around the origin: 


cosa —sina 
(z,9) = Ба COS 4 (x,y). (4.2.2) 


3. Rotation through a (counterclockwise) around an arbitrary point (x o, yo): 


cosa —sina 
(x,y) > (жо, Yo) ES 2 COS 2 (т -409У- %). (4.2.3) 
4. Re ec Поп: 
in the x-axis: (2,0) (x, —y), 
in the y-axis: (x,y) > (=x, y), (4.2.4) 
in the diagonal x = y: (x,y) > (y. 2). 
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5. Re ec Поп in a line with equation ag + by + c = 0: 


1 b —a? — —2ab 
(zy) > 215 (| ae E i) (ж, y) — (Zac, эд) . (42.5) 


6. Re ec tion in a line going through (20, уо) and making an angle a with the 
x-axis: 


cos 2a sin 20 


sin2a  — cos A (x — zo, y — Yo). (4.2.6) 


S E | 


7. Glide-re ection in a line L with displacement d: Apply rst a re ection in L, 
then a translation by a vector of length d in the direction of L, that is, by the 
vector 


1 


if L has equation az + by +c = 0. 


4.2.2 FORMULAE FOR SYMMETRIES: HOMOGENEOUS 
COORDINATES 

All isometries of the plane can be expressed in homogeneous coordinates in terms 

of multiplication by a matrix. This fact is useful in implementing these transforma- 


tions on a computer. It also means that the successive application of transformations 
reduces to matrix multiplication. The corresponding matrices are as follows: 


1. Translation by (xo, yo): 


Таою) = [ 1 a (4.2.8) 
00 1 | 


2. Rotation through a around the origin: 


[ona —sina | 
Ra = E s 1 . (4.2.9) 


3. Re ec tion in a line going through the origin and making an angle a with the 


z-axis: 
cos 2a sin 2a 0 
M. = |sin2a -сов2а 0|. (4.2.10) 
0 0 1 


From this one can deduce all other transformations. 
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EXAMPLE То nd the matrix for a rotation through a around an arbitrary point Р = 
(Zo, yo), we apply a translation by — (20, yo) to move P to the origin, a rotation 
through a around the origin, and then a translation by (xo, yo): 


cosa —sina то — To Cosa + yosina 
То) RaT (zo,y0) = | Sina сова Yo — уо СОЗО — Xosina (4.2.11) 
0 0 1 


(notice the order of the multiplication). 


4.2.3 FORMULAE FOR SYMMETRIES: POLAR COORDINATES 


1. Rotation around the origin through an angle a: 


(7,0) > (1,9 + a). (4.2.12) 


2. Re ec tion in a line through the origin and making an angle a with the positive 
x-axis: 


(r,0) — (r, 2a — 0). (4.2.13) 


4.2.4 CRYSTALLOGRAPHIC GROUPS 


A group of symmetries of the plane that is doubly in nite is a wallpaper group, 
or crystallographic group. There are 17 types of such groups, corresponding to 17 
essentially distinct ways to tile the plane in a doubly periodic pattern. (There are also 
230 three-dimensional crystallographic groups.) 

The simplest crystallographic group involves translations only (page 309, top 
left). The others involve, in addition to translations, one or more of the other types of 
symmetries (rotations, re ection s, glide-re ections). The Conway notation for crys- 
tallographic groups is based on the types of non-translational symmetries occurring 
in the “simplest description” of the group: 


1. ° indicates a translations only, 

2. * indicates a re ection (mirror symmetry), 

3. * a glide-re ection, 

4. a number n indicates a rotational symmetry of order n (rotation by 360? /n). 


In addition, if a number n comes after the *, the center of the corresponding rotation 
lies on mirror lines, so that the symmetry there is actually dihedral of order 2n. 

Thus the group ** in the table below (page 309, middle left) has two inequivalent 
lines of mirror symmetry; the group 333 (page 311, top right) has three inequivalent 
centers of order-3 rotation; the group 22* (page 309, bottom right) has two inequiv- 
alent centers of order-2 rotation as well as mirror lines; and *632 (page 311, bottom 
right) has points of dihedral symmetry of order 12(— 2 x 6), 6, and 4. 

The following table gives the groups in the Conway notation and in the notation 
traditional in crystallography. It also gives the quotient space of the plane by the 
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action of the group. The entry “4,4,2 turnover” means the surface of a triangular puff 
pastry with corner angles 45°(= 1809/4), 45° and 90°. The entry “4,4,2 turnover 
slit along 2,4” means the same surface, slit along the edge joining a 45° vertex to 
the 90° vertex. Open edges are silvered (mirror lines); such edges occur exactly for 
those groups whose Conway notation includes a * 

The last column of the table gives the dimension of the space of inequivalent 
groups of the given type (equivalent groups are those that can be obtained from one 
another by proportional scaling or rigid motion). For instance, there is a group of 
type ° for every shape parallelogram, and there are two degrees of freedom for the 
choice of such a shape (say the ratio and angle between sides). Thus, the ° group of 
page 309 (top left) is based on a square fundamental domain, while for the ° group 
of page 311 (top left) a fundamental parallelogram would have the shape of two 
juxtaposed equilateral triangles. These two groups are inequivalent, although they 
are of the same type. 


Look on page 


309 top left; 
311 top left 
309 top right Klein bottle 


ы 


Torus 


309 middle left 
309 middle right 
309 bottom left 
309 bottom right 
310 top left 

310 top right 
310 middle left 
310 middle right 
310 bottom left 
310 bottom right 
311 top right 
311 middle left 
311 middle right 
311 bottom left 
311 bottom right 


Cylinder 

Möbius strip 

Nonorientable football 
Open pillowcase 

Closed pillowcase 

4,4,2 turnover, slit along 4,4 
Square 

4,4,2 turnover 

4,4,2 turnover, slit along 4,2 
4,4,2 triangle 

3,3,3 turnover 

3,3,3 triangle 

6,3,2 turnover, slit along 3,2 
6,3,2 turnover 

6,3,2 triangle 
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The gures on pages 309-311 show wallpaper patterns based on each of the 17 
types of crystallographic groups (two patterns are shown for the °, or translations- 
only, type). Thin lines bound unit cells, or fundamental domains. When solid, they 
represent lines of mirror symmetry, and are fully determined. When dashed, they 
represent arbitrary boundaries, which can be shifted so as to give different funda- 
mental domains. One can even make these lines into curves, provided the symmetry 
is respected. Dots at the intersections of thin lines represent centers of rotational 
symmetry. 

Some of the relationships between the types are made obvious by the patterns. 
For instance, on the rst row of page 309, we see that the group on the right, of type 
xx contains the one on the left, of type °, with index two. However, there are more 
relationships than can be indicated in a single set of pictures. For instance, there is a 
group of type ** hiding in any group of type 3*3. 
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4.2.5 CLASSIFYING THE CRYSTALLOGRAPHIC GROUPS 


To classify an image representing a crystallographic group, answer the following 
sequence of questions starting with: “What is the minimal rotational invariance?". 


e None 
Is there a re ection? 
- No. 
Is there a glide-re ection? 
* No: pl (page 309) 
* Yes: pg (page 309) 
- Yes. 
Is there a glide-re ection in 
an axis that is not a re ection 
axis? 
* No: pm (page 309) 
+ Yes: cm (page 309) 


e 2-fold (180° rotation) 
Is there a re ection? 
- No. 
Is there a glide-re ection? 
* No: p2 (page 310) 
+ Yes: рге (page 309) 
— Yes. 
Are there re ections in two di- 
rections? 
+ No: pmg (page 309) 
ж Yes: Are all rotation cen- 
ters on re ection axes? 


e 3-fold (120° rotation) 
Is there a re ection ? 
- No: p3 (page 311) 
— Yes. 
Are all centers of threefold ro- 
tations on re ection axes? 


ж No: p31m (page 311) 
+ Yes: p3ml (page 311) 


e 4-fold (90° rotation) 
Is there a re ection ? 
— No: p4 (page 310) 
— Yes. 
Are there four re ection axes? 
+ No: p4g (page 310) 
+ Yes: p4m (page 310) 


e 6-fold (60° rotation) 
Is there a re ection ? 
— No: рб (page 311) 
- Yes: póm (page 311) 


- No: cmm (page 310) 
: Yes: pmm (page 310) 


4.3 OTHER TRANSFORMATIONS OF THE PLANE 


4.3.14 SIMILARITIES 


A transformation of the plane that preserves shapes is called a similarity. Every sim- 
ilarity of the plane is obtained by composing a proportional scaling transformation 
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(also known as a homothety) with ап isometry. A proportional scaling transformation 
centered at the origin has the form 


(x,y) + (ax, ay), (4.3.1) 


where a Z 0 is the scaling factor (a real number). The corresponding matrix in 
homogeneous coordinates is 


|a 0 0) 
Н, = |0 a Ol. (4.3.2) 
lo 0 1| 


In polar coordinates, the transformation is (7,0) > (ar, 8). 


4.3.2 AFFINE TRANSFORMATIONS 


A transformation that preserves lines and parallelism (maps parallel lines to parallel 
lines) is an afne transformation. There are two important particular cases of such 
transformations: 


A non-proportional scaling transformation centered at the origin has the form 
(x,y) > (ax, by), where a,b # 0 are the scaling factors (real numbers). Тһе 
corresponding matrix in homogeneous coordinates is 


a 0 0 
Н,,- |0 b 0|. (4.3.3) 
001 


A shear preserving horizontal lines has the form (x,y) -» (ж + ту, у), where r 
1s the shearing factor (see Figure 4.6). The corresponding matrix in homogeneous 
coordinates is 


ШІ 
5,- o : 1 (4.3.4) 


Every af ne transformation is obtained by composing a scaling transformation with 
an isometry, or a shear with a homothety and an isometry. 


FIGURE 4.6 


A shear with factor r — i. 
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FIGURE 4.7 
A perspective transformation with center O, mapping the plane P to the plane Q. The trans- 


formation is not de п ed on the line L, where Р intersects the plane parallel to Q and going 
through O. 


4.3.3 PROJECTIVE TRANSFORMATIONS 


A transformation that maps lines to lines (but does not necessarily preserve paral- 
lelism) is a projective transformation. Any plane projective transformation can be 
expressed by an invertible 3 x 3 matrix in homogeneous coordinates; conversely, 
any invertible З x З matrix de nes а projective transformation of the plane. Projec- 
tive transformations (if not af ne) are not de ned on all of the plane but only on the 
complement of a line (the missing line is “mapped to in nity“). 

A common example of a projective transformation is given by a perspective 
transformation (Figure 4.7). Strictly speaking this gives a transformation from one 
plane to another, but, if we identify the two planes by (for example) xing a Cartesian 
system in each, we get a projective transformation from the plane to itself. 


4.4 LINES 
The (Cartesian) equation of a straight line is linear in the coordinates x and y: 


ax + by+c=0. (4.4.1) 


The slope of this line is —a/b, the intersection with the x-axis (or x-intercept) is 
x = —c/a, and the intersection with the y-axis (or y-intercept) is y = —c/b. If 
a = 0, the line is parallel to the x-axis, and if b = 0, then the line is parallel to the 
y-axis. 
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(In an oblique coordinate system, everything in the preceding paragraph remains 
true, except for the value of the slope.) 

When a? + b“ = 1 and c < 0 in the equation az + by + с = 0, the equation 
is said to be in normal form. In this case —c is the distance of the line to the origin, 
and ш (with созш = a and sinw = b) is the angle that the perpendicular dropped to 
the line from the origin makes with the positive z-axis (Figure 4.8, with p = —c). 

To reduce an arbitrary equation ax + by + c = 0 to normal form, divide by 
+уа? + b?, where the sign of the radical is chosen opposite the sign of c when 
c + 0 and the same as the sign of b when c = 0. 


FIGURE 4.8 


The normal form of the line L is x cosw + y sinw = p. 


4.4.1 


. Slope of line going through points (20, yo) and (z1,y1): 


y 


LINES WITH PRESCRIBED PROPERTIES 


. Line of slope m intersecting the x-axis at x = zo: y = m(x — xo). 
. Line of slope m intersecting the y-axis at y = yo: y — mz + yo. 


. Line intersecting the z-axis at x = xo and the y-axis at y = yo: 


pd eng 
To Yo 


(This formula remains true in oblique coordinates.) 


. Line of slope m passing though (zo, yo): y — yo = M(x — zo). 


. Line passing through points (xo, yo) and (71,41): 


x. - т y 1 
y- Yı 9-0 Ši Ree Yo 2:0: 
2-- 21 20-71 2 yi 1 


(These formulae remain true in oblique coordinates.) 


Yı — Yo 
21-70. 
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(4.4.2) 


(4.4.3) 


7. Line passing through points with polar coordinates (то, до) and (71,61): 


т(то sin(9 — 00) — rı sin(6 — 01)) = rorisin(0; — 9%). (4.4.4) 


4.4.2 DISTANCES 


The distance between two points in the plane is the length of the line segment joining 
the two points. If the points have Cartesian coordinates (20, yo) and (x1, yi), this 
distance is 


(ei — хо)? + (уз — go)". (4.4.5) 


If the points have polar coordinates (то, 0o) and (11,61), this distance is 


V rà +r? — 2rori cos(90 — 61). (4.4.6) 


If the points have oblique coordinates (xo, yo) and (x1, y1), this distance is 


(x1 — то)? + (уз — yo)? + 2(z1 — 20) 01 — Yo) созш, (4.4.7) 


where ш is the angle between the axes (Figure 4.5). 
The point k% of the way from Ро = (zo, yo) to P, = (21,01) is 


и Se | (4.4.8) 


100 100 


(The same formula also works in obligue coordinates.) This point divides the seg- 
ment PP; in the ratio k : (100 — k). As a particular case, the midpoint of Po Pj is 
given by (5 (20 + 21), 2(ю + 1)) - 

The distance from the point (xo, yo) to the line az + by + c = 015 


azo + byo + c 
Sp аа | (4.4.9) 
Ма? + b? 
4.4.3 ANGLES 
The angle between two lines аох + boy + со = О and a4z + biy + ci = 0 15 
b b by — аЬ 
juu uh — tan™! Est 0-1 M (4.4.10) 
a1 a0 aoaı + bob, 


In particular, the two lines are parallel when agb1 = албо, and perpendicular when 
aga, = -бобі. 

The angle between two lines of slopes mo and m; is tan“) (m1) — tan“) (mo) 
(or tan“! ((m4 — mo)/(1 + mom ))). In particular, the two lines are parallel when 
mo = mı and perpendicular when mpm, = —1. 
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4.4.4 CONCURRENCE AND COLLINEARITY 


Three lines aoz + boy + со = 0, aix + biy + с = 0, and aox + boy + сә = 0 аге 
concurrent (1.е., intersect at a single point) if and only if 


ао bo Co 
ал bi С1| = 0. (4.4.11) 
аә b» сә 


(This remains true in obligue coordinates.) 
Three points (zo, yo), (21,01), and (x2, y2) are collinear (i.e., all three points 
are on a straight line) if and only if 


To yo 1 
zi уу 1|=0. (4.4.12) 
X2 1/9 1 


(This remains true іп obligue coordinates.) 
Three points with polar coordinates (ro, бо), (71,61), and (12, 02) are collinear 
if and only if 


TITA sin(05 = 01) + rori sin(91 zx 90) + Leto віп(00 = 0») -0. (4.4.13) 


4.5 POLYGONS 


Given k > 3 points А1,..., Ак in the plane, in a certain order, we obtain a k-sided 
polygon or k-gon by connecting each point to the next, and the last to the rst, witha 
line segment. The points A, are the vertices and the segments A, А; уу are the sides 
or edges of the polygon. When Ё = 3 we have a triangle, when k = 4 we have a 
quadrangle or quadrilateral, and so on (see page 324 for names of regular polygons). 
Here we will assume that all polygons are simple: this means that no consecutive 
edges are on the same line and no two edges intersect (except that consecutive edges 
intersect at the common vertex) (see Figure 4.9). 


FIGURE 4.9 
Two simple quadrilaterals (left and middle) and one that is not simple (right). We will treat 


only simple polygons. 
А1 


А А 
Б Аз Ao ? Аз 


А А 
i Ал Ал й Ал 
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When we refer to the angle at a vertex А, we have in mind the interior angle 
(as marked in the leftmost polygon in Figure 4.9). We denote this angle by the same 
symbol as the vertex. The complement of A, is the exterior angle at that vertex; 
geometrically, it is the angle between one side and the extension of the adjacent side. 
In any k-gon, the sum of the angles equals 2(k — 2) right angles, or 2(k — 2) x 90°; 
for example, the sum of the angles of a triangle is 180°. 

The area of a polygon whose vertices A; have coordinates (ж, yi), for 1 <i < 
k, is the absolute value of 


area = 5(€1yo — тол) ++ Sra — TkYk—1) + (тул — 2108), 


(4.5.1) 


NI = ые 


k 
У (тинн — йй), 
2-1 


where in the summation we take 7441 = 21 and yz41 = yı. In particular, for a 
triangle we have 


1 21 yı 1 
area = 5 (2102 — xoy1 + 2913 — 0319 + T3Y1 — 2103) = 2 |22 0 11. (4.5.2) 
Z3 ys 1 


In oblique coordinates with angle w between the axes, the area is as given above, 
multiplied by sin w. 
If the vertices have polar coordinates (r;,0;), for 1 < i < k, the area is the 


absolute value of 
k 


1 , 
area — 2 2, TiTir1 sin(O;44 — 9,), (4.5.3) 
12 
where we take тафт = rı and 6,41 = 61. 
Formulae for speci c polygons in terms of side lengths, angles, etc., are given 
on the following pages. 


4.5.1 TRIANGLES 


Because the angles of a triangle add up to 180°, at least two of them must be acute 
(less than 90°). In an acute triangle all angles are acute. A right triangle has one 
right angle, and an obtuse triangle has one obtuse angle. 

The altitude corresponding to a side is the perpendicular dropped to the line 
containing that side from the opposite vertex. The bisector of a vertex is the line 
that divides the angle at that vertex into two equal parts. The median is the segment 
joining a vertex to the midpoint of the opposite side. See Figure 4.10. 

Every triangle also has an inscribed circle tangent to its sides and interior to 
the triangle (in other words, any three non-concurrent lines determine a circle). The 
center of this circle is the point of intersection of the bisectors. We denote the radius 
of the inscribed circle by r. 

Every triangle has a circumscribed circle going through its vertices; in other 
words, any three non-collinear points determine a circle. The point of intersection of 
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FIGURE 4.10 
Notations for an arbitrary triangle of sides a, b, c and vertices A, B, C. The altitude cor- 


responding to С is he, the median is те, the bisector is te. The radius of the circumscribed 


circle is R, that of the inscribed circle is r. 


the medians is the center of mass of the triangle (considered as an area in the plane). 
We denote the radius of the circumscribed circle by R. 

Introduce the following notations for an arbitrary triangle of vertices A, B, C 
and sides a, b, c (see Figure 4.10). Let he, te, and m, be the lengths of the altitude, 
bisector, and median originating in vertex С, let r and R be as usual the radii of the 
inscribed and circumscribed circles, and let s be the semi-perimeter: s = $(at+b+c). 
Then 


A+B+C = 180° 
c = а? +b? —2abcosC (law of cosines), 
a = bcosC + ccosB, 


а _ b 2 
sin4 sinB sinC 


(law of sines), 


2 . . 
nd pe а ВС ТИЕ abc 
area = ghee = zabsinC = -- mG Ric 
= \/s(s — a)(s — b)(s — c) (Heron), 
bsin С 
r = csin(3 A) sin($B) sec(3C) = — = (s — c) tan(1C), 
gr nins 
ha hp he 1 
с абс 
шар 2sinC  4агва” 
he = asin В —bsin A = ав, 
с 
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/1 1 1 
Me = 5а? + 202 = те. 


A triangle is equilateral if all of its sides have the same length, or, equivalently, 
if all of its angles are the same (and equal to 60°). It is isosceles if two sides are the 
same, or, equivalently, if two angles are the same. Otherwise it is scalene. 

For an equilateral triangle of side a we have 


area = 102/3, r=tav3, R=tav3, h= žav3, (4.5.4) 


where h is any altitude. The altitude, the bisector, and the median for each vertex 
coincide. 

For an isosceles triangle, the altitude for the uonequal side is also the corre- 
sponding bisector and median, but this is not true for the other two altitudes. Many 
formulae for an isosceles triangle of sides a, a, с can be immediately derived from 
those for a right triangle of legs a, ic (see Figure 4.11, left). 

For a right triangle, the hypotenuse is the longest side and is opposite the right 
angle; the legs are the two shorter sides adjacent to the right angle. The altitude for 
each leg equals the other leg. In Figure 4.11 (right), ^ denotes the altitude for the 
hypotenuse, while m and n denote the segments into which this altitude divides the 
hypotenuse. 

The following formulae apply for a right triangle: 


A+B=90°, c = а? +b? (Pythagoras), 
= ab R= 1 
С atbte’ х 
а = csin А = ccos В, b = csin В = ссозА, 
mc = 0°, neza“, 
area = sab, he = ab. 


FIGURE 4.11 


Left: an isosceles triangle can be divided into two congruent right triangles. Right: notations 
for a right triangle. 
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FIGURE 4.12 


Left: 


Ceva’s theorem. Right: Menelaus’s theorem. 
A A 
F Е, 
Е 
Е 
В 
D С В C D 


The hypotenuse is a diameter of the circumscribed circle. The median joining 


the midpoint of the hypotenuse (the center of the circumscribed circle) to the right 
angle makes angles 2А and 2B with the hypotenuse. 


1. 


Additional facts about triangles: 


In any triangle, the longest side is opposite the largest angle, and the shortest 
side is opposite the smallest angle. This follows from the law of sines. 


. Ceva’s theorem (see Figure 4.12, left): In a triangle ABC, let D, E, and F 
be points on the lines BC, СА, and AB, respectively. Then the lines AD, 
BE, and СЕ are concurrent if, and only if, the signed distances BD, CE,... 
satisfy 

BD.CE АЕ = DC- EA. FB. (4.5.5) 
This is so in three important particular cases: when the three lines are the 


medians, when they are the bisectors, and when they are the altitudes. 


. Menelaus’s theorem (see Figure 4.12, right): In a triangle ABC, let D, E, and 
F be points on the lines BC, CA, and AB, respectively. Then D, E, and F 
are collinear if, and only if, the signed distances BD, C E, ... satisfy 


BD.CE AF —-DC - EA. FB. (4.5.6) 


. Each side of a triangle is less than the sum of the other two. For any three 
lengths such that each is less than the sum of the other two, there is a triangle 
with these side lengths. 

. Determining if a point is inside a triangle 
Given а triangle's vertices ( Po, Рі, P>} and the test point Рз, place Po at the 
origin by subtracting its coordinates from each of the others. Then compute 
(here P; = (x, yi)) 

а = 21)2- 7201, 
b = 2143 — 2341, (4.5.7) 


€ = L2Y3 — 2302 
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The point Р, is inside the triangle { Po, P,, P2} if and only if 
ab>0 and ac<0 and a(a—b+c)>0 (4.5.8) 


4.5.2 QUADRILATERALS 


The following formulae give the area of a general guadrilateral (see Figure 4.13, 
left, for the notation). 


area = $pqsin# = +(b° + d? — а — c?) tan 
= 4v Ap!q? — (b? + Ф — až — c? (4.5.9) 


= \/ (s — a)(s — b)(s — c) (s — d) — abedcos (А + C). 


FIGURE 4.13 
Left: notation for a general guadrilateral, in addition s — “(а +b+c+d). Right: a 


parallelogram. 


Often, however, 1t is easiest to compute the area by dividing the guadrilateral into 
triangles. One can also divide the guadrilateral into triangles to compute one side 
given the other sides and angles, etc. 

More formulae can be given for special cases of guadrilaterals. In a parallel- 
ogram, opposite sides are parallel and the diagonals intersect in the middle (Fig- 
ure 4.13, right). It follows that opposite sides have the same length and that two 
consecutive angles add up to 180°. In the notation of the gure, we have 


А-С, B=D; А + В = 180°, 
h = asin А = asin В, area = bh, 


р = Va? + b? — 2ab cos A, а= Ма? + b? — 2ab cos B. 


(All this follows from the triangle formulae applied to the triangles ABD and ABC.) 
Two particular cases of parallelograms are 


1. The rectangle ©, where all angles equal 90°. The diagonals of a rectangle 
have the same length. The general formulae for parallelograms reduce to 


һ-а, area=ab, and p—g— Va? +02, (4.5.10) 
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2. The rhombus or diamond <> , where adjacent sides have the same length (а = 
b). The diagonals of a rhombus are perpendicular. In addition to the general 
formulae for parallelograms, we have area = рд and p? + q? = 4a?. 


The square or regular quadrilateral is both a rectangle and a rhombus. 
A quadrilateral is a trapezoid if two sides are parallel. D C 
In the notation of the gure on the right we have IBN 
А+р= В+С = 180°, агеа = (АВ + CD)h. 4 е 
The diagonals of a guadrilateral with consecutive sides a, b, с, d are perpendic- 
ular if and only if а? + с? = b? + Ф. 
A quadrilateral is cyclic if it can be inscribed in a circle, that is, if its four vertices 
belong to a single, circumscribed, circle. This is possible if and only if the sum of 


opposite angles is 180°. If R is the radius of the circumscribed circle, we have (in 
the notation of Figure 4.13, left) 


area = y (s — a)(s — b)(s — c)(s — d) = $(ac + bd) sin 8, 
v (ac + bd)(ad + bc)(ab + ed) 


скис: ише (Brahmagupta), 
[ac + bd) (ab + cd) 
"c (ad 4- bc) | 
R= 1 [(ac + bd)(ad + be)(ab + cd) 
© 4V (s —a)(s — b)(s — c)(s — 4) 
. 2 area 
dm ac + bd" 


pa—ac+bd (Ptolemy). 


A quadrilateral is circumscribable if it has an inscribed circle (that is, a circle 
tangent to all four sides). Its area is rs, where r is the radius of the inscribed circle 
and s is as above. 

For a quadrilateral that is both cyclic and circumscribable, we have the following 
additional equalities, where m is the distance between the centers of the inscribed 
and circumscribed circles: 


a+c2b+d, area = Vabcd = rs, 


R= 1 /(ac + bd)(ad + be)(ab + cd) A. 1 А 1 
4 abed ' mp (R—-mp (R+m)?" 


4.5.3 REGULAR POLYGONS 


A polygon is regular if all its sides are equal and all its angles are equal. Either 
condition implies the other in the case of a triangle, but not in general. (A rhombus 
has equal sides but not necessarily equal angles, and a rectangle has equal angles but 
not necessarily equal sides.) 
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For a k-sided regular polygon of side a, let 9 be the angle at any vertex, and r 
and R the radii of the inscribed and circumscribed circles (ғ is called the apothem). 
As usual, let s = ska be the half-perimeter. Then 


k—2 
6 = (~~) 180° 
| k ) | 


180° 180° 
а= 2rtan > = 2Rsin s 7 
180 1809 
area = tka’ cot TA = kr? tan 


360° 
= ЕБ? sin 23 
Ё , 
180? 


т = žacot 


R= žacsc 


Equilateral triangle 0.43301 a? | 0.28868 a | 0.57735 a 
Square a? | 0.500004 | 0.70711 a 
Regular pentagon 1.72048 a? | 0.68819 a | 0.85065 a 
Regular hexagon 2.59808 a? | 0.86603 a a 


Regular heptagon 3.63391 a? | 1.03826 a | 1.15238 a 
Regular octagon 4.82843 a? | 1.207114 | 1.30656 a 
Regular nonagon 6.18182 a? | 1.373744 | 1.461904 
Regular decagon 7.69421 a? | 1.538844 | 1.61803 a 
Regular undecagon 9.36564 a? | 1.702844 | 1.774734 
Regular dodecagon 11.19625 a? | 1.86603 a | 1.93185 a 


If aj, denotes the side of a k-sided regular polygon inscribed in a circle of radius 


R, we have 
azk = 4| 2R? — Ry/4R? — аў. (4.5.11) 


If Ак denotes the side of a k-sided regular polygon circumscribed about the same 


circle, 
2 RA. 


28+ А82 + А] 


_ акАк |. (а, Ар 
А = лз а = y 2028, (4.5.13) 


The areas Sk, $54, Sk, and S», of the same polygons satisfy 


28045 
EDA EE, (4.5.14) 
Sop + Sk 


257 (4.5.12) 


In particular, 
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4.6 CONICS 


A conic (or conic section) 1s a plane curve that can be obtained by intersecting a right 
circular cone (page 361) with a plane that does not go through the vertex of the cone. 
There are three possibilities, depending on the relative positions of the cone and the 
plane (Figure 4.14). If no line of the cone is parallel to the plane, then the intersection 
is a closed curve, called an ellipse. If one line of the cone is parallel to the plane, 
the intersection is an open curve whose two ends are asymptotically parallel; this is 
called a parabola. Finally, there may be two lines in the cone parallel to the plane; 
the curve in this case has two open segments, and is called a hyperbola. 


FIGURE 4.14 
A section of a cone by a plane can yield an ellipse (left), a parabola (middle) or a hyperbola 


(right). 


ЗООЖ 


4.6.1 ALTERNATIVE CHARACTERIZATION 


Assume given a point F in the plane, a line d not going through F, and a positive 
real number e. The set of points P such that the distance PF is e times the distance 
from P to d (measured along a perpendicular) is a conic. We call F the focus, d the 
directrix, and e the eccentricity of the conic. If e < 1 we have an ellipse, ife = 1a 
parabola, and if e > 1 a hyperbola (Figure 4.15). This construction gives all conics 
except the circle, which is a particular case of the ellipse according to the earlier 
de nition (we can recover it by taking the limit e — 0). 

For any conic, a line perpendicular to d and passing through F is an axis of 
symmetry. The ellipse and the hyperbola have an additional axis of symmetry, per- 
pendicular to the rst, so that there is an alternate focus and directrix, Р” and ď, 
obtained as the re ection of F and d with respect to this axis. (By contrast, the focus 
and directrix are uniquely de ned for a parabola.) 

The simplest analytic form for the ellipse and hyperbola is obtained when the 
two symmetry axes coincide with the coordinate axes. The ellipse in Figure 4.16 has 
equation 


-+5 21, (4.6.1) 
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FIGURE 4.15 


De nition of conics by means of the ratio (eccentricity) between the distance to a point and 
the distance to a line. On the left, е = .7 (ellipse); in the middle, е = 1 (parabola); on the 
right, e — 2 (hyperbola). 


d d d 
Р, Р Р 
F F 


with b < a. The x-axis is the major axis, and the y-axis is the minor axis. These 
names are also applied to the segments, determined on the axes by the ellipse, and 
to the lengths of these segments: 2a for the major axis and 2b for the minor. The 
vertices are the intersections of the major axis with the ellipse and have coordinates 
(a, 0) and (—a, 0). The distance from the center to either focus is уа? — b?, and the 
sum of the distances from a point in the ellipse to the foci is 2a. The latera recta 
(in the singular, latus rectum) are the chords perpendicular to the major axis and 
going through the foci; their length is 25? /a. The eccentricity is Va? — b?/a. All 
ellipses of the same eccentricity are similar; in other words, the shape of an ellipse 
depends only on the ratio b/a. The distance from the center to either directrix is 
a?/va? — 2. 


The hyperbola in Figure 4.17 has equation 


вя (4.6.2) 


FIGURE 4.16 


Ellipse with major semiaxis a and minor semiaxis b. Here b/a — 0.6. 
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FIGURE 4.17 


Hyperbola with transverse semiaxis a and conjugate semiaxis b. Here b/a — 0.4. 


The z-axis is the transverse axis, and the y-axis is the conjugate axis. The 
vertices are the intersections of the transverse axis with the hyperbola and have co- 
ordinates (a,0) and (—a,0). The segment thus determined, or its length 2a, is also 
called the transverse axis, while the length 26 is also called the conjugate axis. The 
distance from the center to either focus is уа? + b, and the difference between the 
distances from a point in the hyperbola to the foci is 2a. The latera recta are the 
chords perpendicular to the transverse axis and going through the foci; their length 
is 2b?/a. The eccentricity is Va? + b? Ја. The distance from the center to either 
directrix is а? / V/a? + b?. The legs of the hyperbola approach the asymptotes, lines 
of slope +b/a that cross at the center. 

All hyperbolas of the same eccentricity are similar; in other words, the shape 
of a hyperbola depends only on the ratio b/a. Unlike the case of the ellipse (where 
the major axis, containing the foci, is always longer than the minor axis), the two 
axes of a hyperbola can have arbitrary lengths. When they have the same length, so 
that a = b, the asymptotes are perpendicular, and e = у, the hyperbola is called 
rectangular. 

The simplest analytic form for the parabola is obtained 
when the axis of symmetry coincides with one coordinate 
axis, and the vertex (the intersection of the axis with the y 
curve) is at the origin. The eguation of the parabola on the 
right is 

2 
y“ = 4ar, (4.6.3) F= (0) 
where a is the distance from the vertex to the focus, or, which x 
is the same, from the vertex to the directrix. The latus rectum 
is the chord perpendicular to the axis and going through the 
focus; its length is 4a. All parabolas are similar: they can be 
made identical by scaling, translation, and rotation. 
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4.6.2 THE GENERAL QUADRATIC EQUATION 
The analytic eguation for a conic in arbitrary position 1s the following: 
Аа? + By? + Cay + Da + Ey+ Е = 0, (4.6.4) 


where at least one of A, B, C is nonzero. To reduce this to one of the forms given 
previously, perform the following steps (note that the decisions are based on the most 
recent values of the coef cients, taken after all the transformations so far): 


1. If C Z 0, simultaneously perform the substitutions © — gx + y and y к 


qy — x, where 
B-AV B-A 
= —— 1 : 4.6. 
4 ( C ) + + C (4.6.5) 


Now C = 0. (This step corresponds to rotating and scaling about the origin.) 
2. If B = 0, interchange x and y. Now В # 0. 


3. If E # 0, perform the substitution y + y — $(E/ B). (This corresponds to 
translating in the y direction.) Now E = 0. 


4. If A=0: 


(a) If D Z 0, perform the substitution x > x — (F/D) (translation in the 
x direction), and divide the equation by B to get Equation (4.6.3). The 
conic is a parabola. 

(b) If D = 0, the equation gives a degenerate conic. If F = 0, we have the 
line y = 0 with multiplicity two. If F < 0, we have two parallel lines 
у = +,/F/B. If F > 0 we have two imaginary lines; the equation has 
no solution within the real numbers. 


5. fA z 0: 


(a) If D Z 0, perform the substitution © > x — $(D/A). Now D = 0. 
(This corresponds to translating in the x direction.) 


(b) If F Z 0, divide the equation by F to get a form with F = 1. 


i. If А and B have opposite signs, the conic is a Ayperbola; to get 
to Equation (4.6.2), interchange x and y, if necessary, so that A is 
positive; then make a — 1/VA апа b = 1/УВ. 

ii. If A апа В аге both positive, the conic is an ellipse; to get to Egua- 
tion (4.6.1), interchange x and y, if necessary, so that A < B, then 
make a = 1/V/A and b = 1/V/B. The circle is the particular case 
a=b. 

iii. If A and B are both negative, we have an imaginary ellipse; the 
equation has no solution in real numbers. 
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(c) If F = 0, the equation again represents a degenerate conic: when А and 
В have different signs, we have a pair of lines y = +/—B/Ar, and, 
when they have the same sign, we get a point (the origin). 


EXAMPLE We work out an example for clarity. Suppose the original equation is 
Ax? +y’ — Ату + 3x — 4y +1 = 0. (4.6.6) 


In step 1 we apply the substitutions z — 2x + y and y — 2y — x. This gives 
2517 + 10x — 5y +1 = 0. Next we interchange x and y (step 2) and get 25/2 + 
10у — 5x +1 = 0. Replacing y by y — 5 in step 3, we get 25y“ — 5a = 0. Finally, in 
step 4a we divide the eguation by 25, thus giving it the form of Eguation (4.6.3) with 
a — 58: We have reduced the сошс to a parabola with vertex at the origin and focus 
at (55, 0). То locate the features of the original curve, we work our way back along 
the chain of substitutions (recall the convention about substitutions and transformations 
from Section 4.1.2): 


Substitution уюу + 1 mh 
Vertex (0, 0) (0, — 2) (—3,0) (-2,-5) 
Focus (20) Q5 014 Ca 


We conclude that the original curve, Equation (4.6.6), is a parabola with vertex 
(-$, -i) and focus (755, 4). 


An alternative analysis of Eguation (4.6.4) consists in forming the guantities 


1 1 
A-iC В ЧЕ, Jg > , Т=А+В, 
3D 3E F : (4.6.7) 
"EE 1р NE lE 
| AD F| (Е Ер 


and nding the appropriate case in the following table, where an entry in parentheses 
indicates that the equation has no solution in real numbers: 


Hyperbola 
Parabola 
«0 Ellipse 
>0 (Imaginary ellipse) 
Intersecting lines 
Point 
< 0 | Distinct parallel lines 
> 0 | (imaginary parallel lines) 
0 | Coincident lines 


For the central conics (the ellipse, the hyperbola, intersecting lines, and the point), 
the center (xo, yo) is the solution of the system of equations 


24x +Cy +D = 0, 
Cz + 2Ву + Е = 0, 
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namely 


2ВР-СЕ oun): (4.6.8) 


(70,40) = ( C? -4AB' С? ААВ 
and the axes have slopes q and —1/q, where q is given by Equation (4.6.5). (The 


value —1/q can be obtained from Equation (4.6.5) by simply placing a minus sign 
before the radical.) The length of the semiaxis with slope q is 


A 1 
АГ where r = 204 -В-ү(В-А)2--С?); (4.6.9) 


note that r is one of the eigenvalues of the matrix of which J is the determinant. To 
obtain the other semiaxis, take the other eigenvalue (change the sign of the radical in 
the expression of r just given). 


EXAMPLE Consider the equation 3x? + 4ry — 2y? + 3x — 2y + 7 = 0. We have 


6 4 3 
A=|4 —4 —2| = —596 40 
3 —2 14 
6 4 
е, MERCED 


We conclude that this is a hyperbola. 


4.6.3 ADDITIONAL PROPERTIES OF ELLIPSES 


Let C be the ellipse with equation x? /a? + y? /b? = 1, with a > b, and let F, F' = 
(tva? — 02,0) be its foci (see Figure 4.16). 


l. A parametric representation for C is (a cos 0, bsin 0) = (v, y) 
given by (асов0, bsin@). The area of 2 
the shaded sector on the right 1s 140 E 
iabcos (х/а). The length of the arc 
from (a, 0) to the point (a cos6, bsin 0) 
is given by the elliptic integral 


af VA - el cos? ddd = a (Е (5%) -Е (5 -6,e)) „ (46.10) 


where e is the eccentricity. (See page 569 for elliptic integrals.) Setting 0 = 2т 
results in 


area of C = тар, perimeter of C = 4a Е(т/2,е). (4.6.11) 


Note the approximation: perimeter of C ~ 2a [2 +(т—2) (2) = . 


2. Given an ellipse in the form Az? + By? + Сту = 1, form the matrix D = 


Et | . Let the eigenvalues of D be (A1, А } and let (Ул, v2) be the cor- 


responding unit eigenvectors (choose them orthogonal if À; = Аз). Then the 
major and minor semi-axes are given by v; — Tu and 
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T 27 
VA _ МААВ-С? 


(b) The ellipse has the parametric representation x(t) = cos(t)v1 +sin(1)v>. 


(a) The area of the ellipse is 


(c) The rectangle with vertices (-Еу 1, +v2) is tangent to the ellipse. 


1-0?  2bt ) 
1+8"1+82/ 
4. The polar eguation for C in the usual polar coordinate system is 


3. A rational parametric representation for C is given by (a 


ы NN (4.6.12) 


Va? sin? 9 + 02 cos? 6 


With respect to a coordinate system with origin at a focus, the eguation 1s 


l 


= ----- 4.6.13 
Ге" ( ) 


where | = b? /а is half the latus rectum. (Use the + sign for the focus with 
positive r-coordinate and the — sign for the focus with negative x-coordinate.) 


5. Let P be any point of C. The sum of the distances PF and PF" is constant 
and equal to 2a. 


6. Let P be any point of C. Then the rays PF and PF" make the same angle 
with the tangent to C at P. Thus any light ray originating at F and re ected 
in the ellipse will go through F". 


7. Let Т be any line tangent to С. The product of the distances from F and F’ to 
T is constant and equals 52, 


8. Lahire's theorem: Let D and D' be x ed lines in the plane, and consider a 
third moving line on which three points P, P', and P" are marked. If we 
constrain P to lie in D and P' to lie in D', then P" describes an ellipse. 


4.6.4 ADDITIONAL PROPERTIES OF HYPERBOLAS 
Let C be the hyperbola with equation x? /a? — y?/b? = 1, and let 


F, F' = (xa? + 02,0) (4.6.14) 


be its foci (see Figure 4.17). The conjugate hyperbola of C is the hyperbola С” with 
equation —z?/a? + y?/b? = 1. It has the same asymptotes as С, the same axes 
(transverse and conjugate axes being interchanged), and its eccentricity e' is related 
to that of C by e’ > + e7? = 1. 
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1. A parametric representation for C is given \ ^ / 


by (авес0, btan 0). A different paramet- \ | 
тїс representation, which gives one branch Ж (а совһ 8, bsinh 6) 
only, is (a cosh 0, bsinh Ө). The area of the D 


shaded sector on the right is 
iab6 = labcosh !(x/a) pá 


x + м2? — а? / 
a 


= iab log 


where x = acosh@. The length of the arc from the point (а, 0) to the point 
(a cosh 0, b sinh 0) is given by the elliptic integral 


0 x 2¢2 2 

А ‚ еа е? -—a 
а | үе cosh? à — 1dd — —bi E(0i, Z =a 4532-35-46, 
| dn ( - „V 22a Ы 


(4.6.15) 
where e is the eccentricity апа? = А/--1. 
2. А rational parametric representation for С is given by 
1-0 26 
——, — |. 4.6.16 
(1-9 178) da 
3. The polar eguation for C in the usual polar coordinate system is 
b 
——— (4.6.17) 
Va? sin? Ө — b? cos? 0 
With respect to a system with origin at a focus, the equation is 
(4.6.18) 
r= — 0. 
1+ єсов0” 


where | = b? /a is half the latus rectum. (Use the — sign for the focus with 
positive r-coordinate and the + sign for the focus with negative x-coordinate.) 


4. Let Р be any point of С. The unsigned difference between the distances PF 
and PF" is constant and egual to 2a. 


5. Let Р be any point of С. Then the rays PF and PF" make the same angle 
with the tangent to C at P. Thus any light ray originating at F and re ected 
in the hyperbola will appear to emanate from Р”. 


6. Let Т be any line tangent to С. The product of the distances from F and Ғ” to 
T is constant and equals 02. 


7. Let Р be any point of С. The area of the parallelogram formed by the asymp- 
totes and the parallels to the asymptotes going through P is constant and equals 
1 
2 ab. 
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8. Let L be any line in the plane. If L intersects C at P and Р” and intersects 
the asymptotes at Q and Q’, the distances PQ and P'Q' are the same. If Г, 
is tangent to C we have Р = Р’, so that the point of tangency bisects the 


segment QQ’. 


4.6.5 ADDITIONAL PROPERTIES OF PARABOLAS 


Let С be the parabola with equation у? = 4az, and let F = (a,0) be its focus. 


1. Let P = (x,y) and Р” = (а, y) be points on C. The area bounded by the 
chord PP! and the corresponding arc of the parabola is 


ly’ — yl? 


4.6.1 
24a la 


It equals four-thirds of the area of the triangle РОР”, where Q is the point on 
C whose tangent is parallel to the chord РР" (formula due to Archimedes). 


2. The length of the arc from (0, 0) to the point (2, y) is 


2 2 Aa + Ag? 
Zat tasih (2) = 24+ 2 + alog УШ as it 
4 a? 2a 4 a? 2a 


(4.6.20) 
3. The polar equation for С in the usual polar coordinate system is 
r= TL (4.6.21) 
With respect to a coordinate system with origin at F, the equation is 
r l (4.6.22) 


mm 
where | = 2a is half the latus rectum. 


4. Let P be any point of C. Then the ray PF and the horizontal line through P 
make the same angle with the tangent to C at P. Thus light rays parallel to the 
axis and re ected in the parabola converge onto F (principle of the parabolic 
re ecto r). 


4.6.6 CIRCLES 


The set of points in a plane whose distance to a x ed point (the center) is a xed 
positive number (the radius) is a circle. A circle of radius r and center (x9, yo) is 
described by the equation 


(z — zo)“ + (у — yo) =r’, (4.6.23) 
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or 
а? + у? — 2x20 — 2yyo + 22 + уд — r^ =0. (4.6.24) 


Conversely, an equation of the form 
т? +y? +2dx + 2ey + f —0 (4.6.25) 


de nes acircleif d?+e? > f; the center is (-а, —e) and the radius is yd? + е? — f. 
Three points not on the same line determine a unique circle. If the points have 
coordinates (21,41), (£2, Y2), and (x3, уз), then the equation of the circle is 


ety т y 
ri by] X1 y 
15 +05 T2 y» 


13 +03 £3 уз 


(4.6.26) 


ні н нн 
Il 
{эже 


A chord of a circle is a line segment between two of its points (Figure 4.18). 
A diameter 1s a chord that goes through the center, or the length of such a chord 


(therefore the diameter is twice the radius). Given two points Рі = (x1,y1) and 
Р, = (x2, y2), there is a unique circle whose diameter is P; P»; its equation is 
(ж — zi)(z — z2) + (y — у1)(у — y») = 0. (4.6.27) 


The length or circumference of a circle of radius r is 2тғ, and the area is rr“. 


The length of the arc of circle subtended by an angle 0, shown as s in Figure 4.18, is 
гд. (All angles are measured in radians.) Other relations between the radius, the arc 
length, the chord, and the areas of the corresponding sector and segment are, in the 
notation of Figure 4.18, 


d= Roos $0 = $ccot $0 = 3 / AR? — с?, 
c = 2Rsin 50 = 2dtan 50 = 2\/ I? — d? = V4h(2R — h), 


d 
0- = = 2 cos7! = 2 ап! 51 edu 23 


area of sector = 1 Rs = 2120, 
area of segment = 4.R?(6 — віп0) = > (Rs — cd) = R? cos“) A - dy R? — dž 
= В? cos"! нээ — (R — h) V2Rh — һ2. 


Other properties of circles: 


1. If the central angle AOB equals 0, the angle AC B, where С is any point on 
the circle, equals 20 or 180° — 20 (Figure 4.19, left). Conversely, given a 
segment AB, the set of points that “see” AB under a x ed angle is an arc of a 
circle (Figure 4.19, right). In particular, the set of points that see AB under a 
right angle is a circle with diameter AB. 


2. Let P,, P», Рз, P4 be points in the plane, and let 4;;, for 1 < 7,3 < 4, be the 
distance between P; and P;. A necessary and suf cient condition for all of the 
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FIGURE 4.18 


The arc of a circle subtended by the angle 0 is s, the chord is с; the sector is the whole slice of 
the pie; the segment is the cap bounded by the arc and the chord (that is, the slice minus the 
triangle). 


FIGURE 4.19 
Left: the angle ACB equals 50 for any C in the long arc AB; ADB equals 180° — 20 for 


any Р in the short arc AB. Right: the locus of points, from which the segment AB subtends 
а xed angle 6, is an arc of the circle. 


© 


points to lie on the same circle (or line) is that one of the following equalities 
be satis ed: 
+dı2d34 + азад + аз = 0. (4.6.28) 


This is equivalent to Ptolemy s formula for cyclic quadrilaterals (page 323). 


3. In oblique coordinates with angle w, а circle of center (То, yo) and radius r is 
described by the equation 


(ж — zo)? + (y — yo)” + 2(ж — то) (у — yo) созш = r°. (4.6.29) 


4. In polar coordinates, the equation for a circle centered at the pole and having 
radius a is r = a. The equation for a circle of radius a passing through the 
pole and with center at the point (7,0) = (а, д0) is r = 2acos(0 — 69). The 
equation for a circle of radius a and with center at the point (7,0) = (ro, до) 
is 

т? — 2ror cos(9 — bo) + ra — а? = 0. (4.6.30) 
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5. If a line intersects a cirele of center O at points А апа В, the segments ОА 
and OB make egual angles with the line. In particular, a tangent line is per- 
pendicular to the radius that goes through the point of tangency. 


6. Fix a circle and a point P in the plane, and consider a line through P that 
intersects the circle at A and B (with A = B for a tangent). Then the product 
of the distances Р.А. PB is the same for all such lines. It is called the power 
of P with respect to the circle. 


4.7 SPECIAL PLANE CURVES 


4.7.1 ALGEBRAIC CURVES 


Curves that can be given in implicit form as f(x,y) = 0, where f is a polynomial, 
are called algebraic. The degree of f is called the degree or order of the curve. Thus, 
conics (page 325) are algebraic curves of degree two. Curves of degree three already 
have a great variety of shapes, and only a few common ones will be given here. 

The simplest case is the curve which is a graph of a polynomial of degree three: 
y = ax? + bz? + cx + d, with a Æ 0. This curve is a (general) cubic parabola 
(Figure 4.20), symmetric with respect to the point В where x = —b/3a. 

The equation of a semi-cubic parabola (Figure 4.21, left) is y? = ka?; by pro- 
portional scaling one can take Ё = 1. This curve should not be confused with the 
cissoid of Diocles (Figure 4.21, middle), whose equation is (a — z)y? = x? with 
a£ 0. 

The latter is asymptotic to the line © = a, whereas the semi-cubic parabola has 
no asymptotes. The cissoid's points are characterized by the equality OP — AB in 
Figure 4.21, middle. One can take a — 1 by proportional scaling. 


FIGURE 4.20 


The general cubic parabola for a > 0. For а < 0, re ect in a horizontal line. 


b? > Зас b? = Зас b? < Зас 
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FIGURE 4.21 


The semi-cubic parabola, the cissoid of Diocles, and the witch of Agnesi. 


М 
е 


More generally, any curve of degree three with equation (r — zo)y? = f(z), 
where f is a polynomial, is symmetric with respect to the x-axis and asymptotic 
to the line 2 = то. In addition to the cissoid, the following particular cases are 
important: 


1. The witch of Agnesi has equation zy? = a?(a — x), with a Z 0, and is 
characterized by the geometric property shown in Figure 4.21, right. The same 
property provides the parametric representation x = асов 0, у = atan. 
Once more, proportional scaling reduces to the case a = 1. 


2. The folium of Descartes (Figure 4.22, left) is described by equation (x — 
a)y? = -а2 (12-40), with a z 0 (reducible to a = 1 by proportional scal- 
ing). By rotating 135° (right) we get the alternative and more familiar equation 
x? +y? = сту, where c = 1а. The folium of Descartes is a rational curve, 
that is, it is parametrically represented by rational functions. In the tilted po- 
sition, the equation is x = ct/(1 +), у = ct?/(1 + 1) (so that t = y/z). 


3. The strophoiď s equation is (x — a)y? = —x?(x + a), with a # 0 (reducible 


to a = 1 by proportional scaling). It satis es the property AP = AP" — OA 
in Figure 4.22, right; this means that POP! is a right angle. The strophoid’s 
polar representation is r = —a cos 20 sec 0, and the rational parametric repre- 
sentation is x = a(t? — 1)/(t? +1), y = at(t? — 1)/(? +1) (so that t = y/z). 


Among the important curves of degree four are the following: 


1. A Cassini's oval is characterized by the following condition: Given two foci 
F and Р”, a distance 2a apart, a point P belongs to the curve if the product of 
the distances PF and PF" is a constant k“. If the foci are on the x-axis and 
equidistant from the origin, the curve's equation is (22 + y? +a”)? — 4a?z? = 
k^. Changes in a correspond to rescaling, while the value of k/a controls 
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FIGURE 4.22 


The folium of Descartes in two positions, and the strophoid. 


FIGURE 4.23 

Cassini"s ovals for k — 0.5a, 0.9a, a, 1.1a and 1.5a (from the inside to the outside). The 
foci (dots) are at x = a and x = —a. The black curve, k = a, is also called Bernoulli’s 
lemniscate. 


the shape: the curve has one smooth segment and one with a self-intersection, 
or two segments depending on whether k is greater than, egual to, or smaller 
than a (Figure 4.23). The case k — ais also known as the lemniscate (of Jakob 
Bernoulli); the equation reduces to (x? + y?)? = a? (£? — y?), and upon a 45° 
rotation to (x? + y?)? = 2a? ry. Each Cassini oval is the section of a torus of 
revolution by a plane parallel to the axis of revolution. 


2. A conchoid of Nichomedes is the set of points such that the signed distance 
AP in Figure 4.24, left, equals a x ed real number k (the line L and the origin 
O being x ed). If L is the line x = a, the conchoid's polar equation is r = 
asec + k. Once more, a is a scaling parameter, and the value of k /a controls 
the shape: when k > —a the curve is smooth, when Ё = —a there is a cusp, 
and when & < —a there is a self-intersection. The curves for Ё and —Ё can 
also be considered two leaves of the same conchoid, with Cartesian equation 
(ж — а)2(22 + у?) = k?z?. 


3. А Птасоп of Pascal is the set of points such that the distance AP in Fig- 
ure 4.25, left, eguals a x ed positive number k measured on either side (the 
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FIGURE 4.24 
De ning property of the conchoid of Nichomedes (left), and curves for k = +0.5a, k = +a, 
and k — +1.5a (right). 


FIGURE 4.25 
De ning property of the limaçon of Pascal (left), and curves for k = 1.5a, k = a, and 
k = 0.5a (right). The middle curve is the cardioid; the one on the right a trisectrix. 


circle C and the origin O being x ed). If C has diameter a and center at 
(0, za), the limagon's polar equation is r = a cos + Б, and its Cartesian 
equation is 

(22 +y? — ax)? = K^ (z? + y?). (4.7.1) 


The value of k/a controls the shape, and there are two particularly interesting 
cases. For k — a, we get a cardioid (see also page 341). For a — sk, we get 
a curve that can be used to frisect an arbitrary angle a. If we draw a line L 
through the center of the circle C making an angle a with the positive x-axis, 
and if we call P the intersection of Ľ with the limacon a = ik, the line from 
O to P makes an angle with L equal to za. 


Hypocycloids and epicycloids with rational ratios (see next section) are also 
algebraic curves, generally of higher degree. 
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FIGURE 4.26 
Cycloid (top) and trochoids with k = 0.5a and k = 1.5a, where k is the distance PQ from 


the center of the rolling circle to the pole. 
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4.7.2 ROULETTES (SPIROGRAPH CURVES) 


Suppose given a x ed curve C and a moving curve M, which rolls on C without 
slipping. The curve drawn by a point P kept x ed with respect to M is called a 
roulette, of which P is the pole. 

The most important examples of roulettes arise when M is a circle and С is 
a straight line or a circle, but an interesting additional example is provided by the 
catenary y = acosh(a/a), which arises by rolling the parabola y = x? /(4а) on the 
x-axis with pole the focus of the parabola (that is, Р = (0, a) in the initial position). 
The catenary is the shape taken under the action of gravity by a chain or string of 
uniform density whose ends are held in the air. 

A circle rolling on a straight line gives a trochoid, with the cycloid as a special 
case when the pole P lies on the circle (Figure 4.26). If the moving circle M has 
radius a and the distance from the pole P to the center of M is k, the trochoid’s 
parametric equation is 


т = аф – ksiný, у = а— kcosé. (4.7.2) 
The cycloid, therefore, has the parametric eguation 
x = а(ф — sin ф), у = a(1 — cos ф). (4.7.3) 


One can eliminate © to get x as a (multivalued) function of y, which takes the fol- 
lowing form for the cycloid: 


a —+ (a cos! (=) -А/Зар — 7?) (4.7.4) 


The length of one arch of the cycloid is 8a, and the area under the arch is Зта 2. 
A trochoid is also called a curtate cycloid when k < a (that is, when P is inside 
the circle) and a prolate cycloid when k > a. 
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FIGURE 4.27 


Left: initial con guration for epitrochoid (black) and con gu ration at parameter value 0 
(gray). Middle: epicycloid with b — ia (nephroid). Right: epicycloid with b = a (cardioid). 


Sic 


A circle rolling on another circle and exterior to it gives an epitrochoid. If a is 
the radius of the x ed circle, b that of the rolling circle, and k is the distance from Р 
to the center of the rolling circle, the parametric equation of the epitrochoid is 


x = (а + Б) соѕ0 — kcos((1 + b/a)8), y = (a + b) sin © — ksin((1 + b/a)0). 
(4.7.5) 
These equations assume that, at the start, everything is aligned along the positive 
x-axis, as in Figure 4.27, left. Usually one considers the case when a/b is a rational 
number, say a/b = p/q where р and g are relatively prime. Then the rolling circle 
returns to its original position after rotating g times around the x ed circle, and the 
epitrochoid is a closed curve—in fact, an algebraic curve. One also usually takes 
k = b, so that P lies on the rolling circle; the curve in this case is called ап epicycloid. 
The middle diagram in Figure 4.27 shows the case b = k = ка, called the nephroid; 
this curve is the cross section of the caustic of a spherical mirror. The diagram on the 
right shows the case b = k = a, which gives the cardioid (compare to Figure 4.25, 
middle). 
Hypotrochoids and hypocycloids are de ned in the same way as epitrochoids and 
epicycloids, but the rolling circle is inside the x ed one. The parametric equation of 
the hypotrochoid is 


x = (a — b) cos + kcos((a/b — 1)0), у = (a — b) sin 9 — ksin((a/b — 1)8), 

(4.7.6) 
where the letters have the same meaning as for the epitrochoid. Usually one takes 
a/b rational and k = b. There are several interesting particular cases: 


e б = k = a gives a point. 
eb=k= ia gives a diameter of the circle С. 


eb=k= za gives the deltoid (Figure 4.28, left), whose algebraic equation is 


(a? +“)? — 8axr? + 24azy? + 18a? (a? + y?) — 27a“ = 0. (АЛЛ) 
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FIGURE 4.28 
The hypocycloids with a — 3b (deltoid) and a — 4b (astroid). 


eb=k= ia gives the astroid (Figure 4.28, right), an algebraic curve of de- 
gree six whose equation can be reduced to 22/3 + 2/8 = a?/?. The gure 
illustrates another property of the astroid: its tangent intersects the coordinate 
axes at points that are always the same distance a apart. Otherwise said, the 
astroid is the envelope of a moving segment of x ed length whose endpoints 
are constrained to lie on the two coordinate axes. 


4.7.3 CURVES IN POLAR COORDINATES 


polar equation type of curve 

r=a circle 

т = acos circle 

т = аѕіп Ө circle 

r? — 2br соѕ(0 — В) + (0 — a?) = 0 circle at (b, 3) of radius a 
k e21 parabola 

PN UE 0<е<1 ellipse 


e>1 hyperbola 


4.7.4 SPIRALS 


A number of interesting curves have polar equation r = f(0), where f is a mono- 
tonic function (always increasing or decreasing). This property leads to a spiral 
shape. The logarithmic spiral or Bernoulli spiral (Figure 4.29, left) is self-similar: 
by rotation the curve can be made to match any scaled copy of itself. Its equation 
is т = ke“, the angle between the radius from the origin and the tangent to the 
curve is constant and equal (0 ф = соё! а. A curve parameterized by arc length 
and such that the radius of curvature is proportional to the parameter at each point is 
a Bernoulli spiral. 

In the Archimedean spiral or linear spiral (Figure 4.29, middle), the spacing 
between intersections along a ray from the origin is constant. The equation of this 
spiral is r = a6; by scaling one can take a = 1. It has an inner endpoint, in contrast 
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FIGURE 4.29 
The Bernoulli or logarithmic spiral (left), the Archimedes or linear spiral (middle), and the 


Cornu spiral (right). 


ф 2та 


with the logarithmic spiral, which spirals down to the origin without reaching it. The 
Cornu spiral or clothoid (Figure 4.29, right), important in optics and engineering, 
has the following parametric representation in Cartesian coordinates: 


t t 
X 2al(t) = a | cos( $55?) ds, y = aS(t) = a | sin(375“) ds. (4.7.8) 
0 0 


(С and S are the so-called Fresnel integrals; see page 547.) A curve parameterized 
by arc length and such that the radius of curvature is inversely proportional to the 
parameter at each point is a Cornu spiral (compare to the Bernoulli spiral). 


4.7.5 THE PEANO CURVE AND FRACTAL CURVES 


There are curves (in the sense of continuous maps from the real line to the plane) 
that completely cover a two-dimensional region of the plane. We give a construction 
of such a Peano curve, adapted from David Hilbert’s example. The construction 
is inductive and is based on replacement rules. We consider building blocks of six 


shapes: d. 27 1 {е , the length of the straight segments being twice 
the radius of the curved ones. A seguence of these patterns, end-to-end, represents a 
curve, if we disregard the gray and black half-disks. The replacement rules are the 
following: 


13 25084 
тэгээ | 
Жазаға, ху 
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The rules are applied taking into account the way each piece is turned. Here we 
apply the replacement rules to a particular initial pattern: 


x 26 
ы ү 


БН 
Do 


(We scale the result so it has the same size as the original.) Applying the process 
repeatedly gives, in the limit, the Peano curve. Note that the sequence converges 
uniformly and thus the limit function is continuous. Here are the first five steps: 


eni! 


The same idea of replacement rules leads to many interesting fractal, and often 
self-similar, curves. For example, the substitution — _, A leads to the 
Koch snowflake when applied to an initial equilateral triangle, like this (the rst three 
stages and the sixth are shown): 


J^ 
204203 
› 4 


4.7.6 FRACTAL OBJECTS 


Given an object X, if т(є) open sets of diameter of є are required to cover X, then 
the capacity dimension of X is 


Inn(e) 


Ine 


capacity = lim (4.7.9) 


indicating that n(e) scales as c^», Note that 


correlation < dinformation < capacity - (4.7.10) 
The capacity dimension of various objects: 


Logistic eguation | Sierpiński sieve 
Cantor set Р Penta ак е 


Koch snowflake . Sierpiňski carpet 
Cantor dust Tetrix 2 
Minkowski sausage 2215 | Mengersponge 2245 a 2.7268 
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4.7.7 CLASSICAL CONSTRUCTIONS 


The ancient Greeks used straightedges and compasses to nd the solutions to numer- 
ical problems. For example, they found square roots by constructing the geometric 
mean of two segments. Three famous problems that have been proved intractable by 
this method are: 


1. The trisection of an arbitrary angle. 

2. The squaring of the circle (the construction of a square whose area is equal to 
that of a given circle). 

3. The doubling of the cube (the construction of a cube with double the volume 
of a given cube). 


A regular polygon inscribed in the unit circle can be constructed by straightedge 
and compass alone if, and only if, n has the form n = 2!pi pa ... Pk, Where £ is a 
nonnegative integer and the 1р; } are zero or more distinct Fermat primes (primes of 
the form 2?" + 1). The only known Fermat primes are for 3, 5, 17, 257, and 65537, 
corresponding to m = 0,1,2,3,4. Thus, regular polygons can be constructed for 
n = 3,4, 5, 6, 8, 10, 12, 15, 16, 17, 20, 24, ..., 257, .... 


4.8 COORDINATE SYSTEMS IN SPACE 


4.8.0.1 Conventions 


When we talk about “the point with coordinates (x, y, z)" or “the surface with equa- 
tion f(x, y, z)", we always mean Cartesian coordinates. If a formula involves an- 
other type of coordinates, this fact will be stated explicitly. Note that Section 4.1.2 
has information on substitutions and transformations relevant to the three-dimensional 
case. 


4.8.1 CARTESIAN COORDINATES IN SPACE 


In Cartesian coordinates (or rectangular coordinates), a point P is referred to by 
three real numbers, indicating the positions of the perpendicular projections from the 
point to three x ed, perpendicular, graduated lines, called the axes. If the coordinates 
are denoted 2:, у, z, in that order, the axes are called the x-axis, etc., and we write 
P = (x,y,z). Often the x-axis is imagined to be horizontal and pointing roughly 
toward the viewer (out of the page), the y-axis also horizontal and pointing more 
or less to the right, and the z-axis vertical, pointing up. The system is called right- 
handed if it can be rotated so the three axes are in this position. Figure 4.30 shows a 
right-handed system. The point © = 0, y = 0, z = 015 the origin, where the three 
axes intersect. 
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FIGURE 4.30 
In Cartesian coordinates, Р = (4.2, 3.4, 2.2). 
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FIGURE 4.31 
Among the possible sets (т,0,2) of cylindrical coordinates for Р are (10,30°,5) and 


(10, 390°, 5). 


4.8.2 CYLINDRICAL COORDINATES IN SPACE 


To dene cylindrical coordinates, we take an axis (usually called the z-axis) and a 
perpendicular plane, on which we choose a ray (the initial ray) originating at the 
intersection of the plane and the axis (the origin). The coordinates of a point P are 
the polar coordinates (r, 9) of the projection of P on the plane, and the coordinate z 
of the projection of P on the axis (Figure 4.31). See Section 4.1.4 for remarks on the 
values of r and 0. 


4.8.3 SPHERICAL COORDINATES IN SPACE 


To de ne spherical coordinates, we take an axis (the polar axis) and a perpendicular 
plane (the equatorial plane), on which we choose a ray (the initial ray) originating 
at the intersection of the plane and the axis (the origin O). The coordinates of a point 
P are the distance p from P to the origin, the angle ф (zenith) between the line OP 
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and the positive polar axis, and the angle 0 (azimuth) between the initial ray and the 
projection of OP to the eguatorial plane. See Figure 4.32. As in the case of polar 
and cylindrical coordinates, 0 is only defined up to multiples of 360°, and likewise ©. 
Usually © is assigned a value between 0 and 180°, but values of © between 180° and 
360? can also be used; the triples (р, 0,0) and (p, 360? — ф, 180° + 0) represent the 
same point. Similarly, one can extend p to negative values; the triples (p, ¢, 0) and 
(—p, 180? — ф, 180? + 0) represent the same point. 


FIGURE 4.32 
A set of spherical coordinates for Р is (p, 0, b) = (10, 60°, 30°). 


FIGURE 4.33 


Standard relations between Cartesian, cylindrical, and spherical coordinate systems. The 
origin is the same for all three. The positive z-axes of the Cartesian and cylindrical systems 
coincide with the positive polar axis of the spherical system. The initial rays of the cylindrical 
and spherical systems coincide with the positive x-axis of the Cartesian system, and the rays 
6 = 90? coincide with the positive y-axis. 
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4.8.4 RELATIONS BETWEEN CARTESIAN, CYLINDRICAL, AND 
SPHERICAL COORDINATES 

Consider a Cartesian, a cylindrical, and a spherical coordinate system, related as 

shown in Figure 4.33. The Cartesian coordinates (x,y,z), the cylindrical coordi- 


nates (7,0, 2), and the spherical coordinates (p, ф, Ө) of a point are related as follows 
(where the tan“! function must be interpreted correctly in all quadrants): 


: y 
sing = ——— , 
x = т с050, т = у? ty, ya? + у? 


› 21V x 
cart + cyl у = т ѕіп 0, 0 = tan“! =, cos = =, 
MM т [gà a? 
ie 224. 
. т 
Safra aie 2 sin ф = ———, 
т = psin ©, 4 мал, 9 Мт? + 2? 
т 
суі + sph z = рсоѕф, ф = tan“! –, COS © — — 
Нэг 2 Ф [pa 22 
020, 0-0. 
р= ма? +? + 22, 
x = pcosÓ sin ф, 6 = tan“! 2, 
cart €» sph у = psin$sin ©, E Vx? +y? 
z = pcos o, 2 
2 
= cos“! 


V + у? +22 


4.8.5 HOMOGENEOUS COORDINATES IN SPACE 


A quadruple of real numbers (x : y : z : t), with t Æ 0, is a set of homogeneous 
coordinates for the point P with Cartesian coordinates (x/t, y/t, z/t). Thus the 
same point has many sets of homogeneous coordinates: (x : y : z : t) and (x" : y! : 
2! : l') represent the same point if, and only if, there is some real number a such that 
27 = ax, у = ay, z = az, ť = at. If P has Cartesian coordinates (xo, yo, 20), 
one set of homogeneous coordinates for Р is (£o, yo, zo, 1). 

Section 4.1.5 has more information on the relationship between Cartesian and 
homogeneous coordinates. Section 4.9.2 has formulae for space transformations in 
homogeneous coordinates. 


4.9 SPACE SYMMETRIES OR ISOMETRIES 


A transformation of space (invertible map of space to itself) that preserves distances 
is called an isometry of space. Every isometry of space is a composition of transfor- 
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mations of the following types: 


. The identity (which leaves every point fixed) 

. À translation by a vector v 

. А rotation through an angle a around a line L 

. A screw motion through an angle o around a line L, with displacement d 

. A re ection in a plane P 

. A glide-re e ction in a plane P with displacement vector v 

. A rotation-re ection (rotation through an angle a around a line L composed 
with reflection in a plane perpendicular to Ľ). 


Mo л ы н 


The identity is a particular case of a translation and of a rotation; rotations are 
particular cases of screw motions; reflections are particular cases of glide-reflections. 
However, as in the plane case, it is more intuitive to consider each case separately. 


4.9.1 FORMULAE FOR SYMMETRIES: CARTESIAN 
COORDINATES 


In the formulae below, multiplication between a matrix and a triple of coordinates 
should be carried out regarding the triple as a column vector (or a matrix with three 
rows and one column). 


1. Translation by (то, уо, zo): 
(x,y,z) (а + xo, y + yo, Z + 20). (4.9.1) 


2. Rotation through o (counterclockwise) around the line through the origin with 
direction cosines а, b, с (see page 353): (x,y,z) + Mx, y, z), where M is 
the matrix 

220 — соза) +cosa ab(l —cosa) —csina ас(1 — cosa) + баша) 
ab(l— cosa) + csina b%1—cosa) +cosa  bc(1— cosa) — asina |. 
[дей — cosa) —bsina bc(1— cosa) +asina c?(1—cosa) + cosa | 

(4.9.2) 


3. Rotation through a (counterclockwise) around the line with direction cosines 
a,b, c through an arbitrary point (£o, yo, 20): 


(2,0,2) > (Zo, Vo, Zo) + M(x 20, Y Yo, Ž zo), (4.9.3) 
where M is given by Equation (4.9.2). 


4. Arbitrary rotations and Euler angles: Any rotation of space fixing the origin 
can be decomposed as a rotation by ф about the z-axis, followed by a rotation 
by 9 about the y-axis, followed by a rotation by % about the z-axis. Тһе 
numbers ©, 0, апа 4) are called the Euler angles of the composite rotation, 
which acts as: (x,y,z) + М(т,у,2), where M is the matrix given by 


cos ф сов cosy —singsiny —sin$cosOcosqv — cososiny sind cosy 
cos $ cos siny + singcosw —sin$cosOsinv + cosdcosy sinf siny |. 
- cos фзіп 0 sin ф sin 9 cos 6 
(4.9.4) 
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FIGURE 4.34 
The coordinate rays Ox, Оу, Oz, together with their images Оё, On, OG under a rotation, x 


the Euler angles associated with that rotation, as follows: 0 = zOG, = zOr = yOs, and 
ф = sOn. (Here the ray Or is the projection of OG to the xy-plane. The ray Os is determined 
by the intersection of the xy- and &y-planes.) 


(An alternative decomposition, more natural if we think of the coordinate 
system as a rigid trihedron that rotates in space, is the following: a rotation 
by % about the z-axis, followed by a rotation by 0 about the rotated y-axis, 
followed by a rotation by ¢ about the rotated z-axis. Note that the order is 
reversed.) 


Provided that 0 is not a multiple of 180?, the decomposition of a rotation in 
this form is unique (apart from the ambiguity arising from the possibility of 
adding a multiple of 360? to any angle). Figure 4.34 shows how the Euler 
angles can be read off geometrically. 


Warning: Some references define Euler angles differently; the most common 
variation is that the second rotation is taken about the x-axis instead of about 
the y-axis. 


5. Screw motion with angle o and displacement d around the line with direction 
cosines a, b, c through an arbitrary point (Zo, yo, 20): 
(x,y,z) 9 (жо + ad, yo + bd, zo + ed) + M (x — xo, y — уо, z — zo), (4.9.5) 
where M 15 given by (4.9.2). 


6. Re ec tion 


in the ry-plane: (x,y,z) > (x, y, —z). 
in the zz-plane: (x,y,z) => (x, —y, 2). (4.9.6) 
in the yz-plane: (2,4,2) њу (=z, y, 2). 
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7. Re ec Поп in a plane with equation az + by + cz 4- d = 0: 


(x,y,z) 9 zrne (M (to, zo) — (2ad, 2bd, 2cd)), (4.9.7) 
where M is the matrix 
ЕШ + 02 + с? —2ab —2ac | 
M — —2ab a? — 02 + с? —2bc . (4.9.8) 
| —2ac —2bc a? + b? — e 


8. Re ec tion in a plane going through (£o, yo, 20) and whose normal has direc- 
tion cosines a, b, c: 
(255) 2) - (то + Yo + 20) + M(x to, y Уо, 2 20), (4.9.9) 
where М is as in (4.9.8). 


9. Glide-re ection in a plane P with displacement vector v: Apply first a reflec- 
tion in P, then a translation by the vector v. 


4.9.2 FORMULAE FOR SYMMETRIES: HOMOGENEOUS 
COORDINATES 


All isometries of space can be expressed in homogeneous coordinates in terms of 
multiplication by a matrix. As in the case of plane isometries (Section 4.2.2), this 
means that the successive application of transformations reduces to matrix multipli- 
cation. (In the formulae below, |  $] is the 4 x 4 projective matrix obtained from 
the 3 x 3 matrix М by adding a row and a column as stated.) 


1 0 0 20 
1. Translation by (20, уо, zo): 00 1 ж 
000 1 
2. Rotation through the origin: | : 
where M 18 given in (4.9.2) or (4.9.4), as the case may be. 
3. Re ec tion in a plane through the origin: bs | : 


where M is given in (4.9.8). 


From this one can deduce all other transformations, as in the case of plane trans- 
formations (see page 303). 
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4.10 OTHER TRANSFORMATIONS OF SPACE 


4.10.1 SIMILARITIES 


A transformation of space that preserves shapes is called a similarity. Every simi- 
larity of space is obtained by composing a proportional scaling transformation (also 
known as a homothety) with an isometry. A proportional scaling transformation cen- 
tered at the origin has the form 

(x,y,z) > (ax, ay,az), (4.10.1) 
where a 3 0 is the scaling factor (a real number). The corresponding matrix in 
homogeneous coordinates 15 


(4.10.2) 


оо ә 
оз © 
S © © 
н © © © 


0 0 0 


In cylindrical coordinates, the transformation is (7,0, z) ++ (ar, 6, az). In spherical 
coordinates, it is (r, Ф,0) к» (ar, ф, Ө). 


4.10.2 AFFINE TRANSFORMATIONS 


A transformation that preserves lines and parallelism (maps parallel lines to parallel 
lines) is an afne transformation. There are two important particular cases of such 
transformations: 


1. A non-proportional scaling transformation centered at the origin has the form 
(x,y, z) > (ах, by, cz), where a,b,c # 0 are the scaling factors (real num- 
bers). The corresponding matrix in homogeneous coordinates is 


a 0 0 0 
0 b 0 0 

Ha b,c = 00 c 0 (4.10.3) 
0 0 0 1 


2. A shear in the x-direction and preserving horizontal planes has the form (z, y, z) 
e (2 + rz,y,2), where r is the shearing factor. The corresponding matrix in 
homogeneous coordinates is 


So (4.10.4) 


ооо н 
оон о 
оно з 
н ооо 


Every affine transformation is obtained by composing a scaling transformation with 
an isometry, or one or two shears with a homothety and an isometry. 
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4.10.3 PROJECTIVE TRANSFORMATIONS 


A transformation that maps lines to lines (but does not necessarily preserve paral- 
lelism) is a projective transformation. Any spatial projective transformation can be 
expressed by an invertible 4 x 4 matrix in homogeneous coordinates; conversely, any 
invertible 4 x 4 matrix defines a projective transformation of space. Projective trans- 
formations (if not affine) are not defined on all of space, but only on the complement 
of a plane (the missing plane is “mapped to infinity“). 

The following particular case is often useful, especially in computer graphics, 
in projecting a scene from space to the plane. Suppose an observer is at the point 
Е = (120,00, 20) of space, looking toward the origin О = (0,0,0). Let Р, the 
screen, be the plane through O and perpendicular to the ray ЕО. Place a rectangular 
coordinate system 67) on P with origin at O so that the positive 7-axis lies in the half- 
plane determined by E and the positive z-axis of space (that is, the z-axis is pointing 
"up" as seen from E). Then consider the transformation that associates with a point 
X = (x,y, z) the triple (€,7, С), where (£, 1) are the coordinates of the point, where 
the line E X intersects P (the screen coordinates of X as seen from E), and 6 is the 
inverse of the signed distance from X to E along the line EO (this distance is the 
depth of X as seen from E). This is a projective transformation, given by the matrix 


—r yo r?zg 0 0 
—TZ9290  —TyoZ rp? 0 

ни | i 4 > (4.10.5) 
-рто —pyo —p% т?р 


with р = \/x2 + ур andr = 4/22 + ya + 22. 


4.11 DIRECTION ANGLES AND DIRECTION 
COSINES 


Given a vector (a, b, c) in three-dimensional space, the direction cosines of this vec- 


tor are 
а 


b 


Va? +1? + с?” (4.11.1) 


с 


Ма? +b2 +02" 


cosa = 
cos f = 
cos y = 
Here the direction angles a, DB, y are the angles that the vector makes with the posi- 


tive 2-, y- and z-axes, respectively. In formulae, usually the direction cosines appear, 
rather than the direction angles. We have 


cos? a + cos? B + cos? y = 1. (4.11.2) 
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4.12 PLANES 


The (Cartesian) equation of a plane is linear in the coordinates x, у, and z: 
ax +by + с2 +d—0. (4.12.1) 


The normal direction to this plane is (a, b, c). The intersection of this plane with the 
x-axis, or x-intercept, 18 x = —d/a, the y-intercept is у = —d/b, and the z-intercept 
is z = —d/c. The plane is vertical (perpendicular to the ry-plane) if c = 0. It is 
perpendicular to the x-axis if b = с = 0, and likewise for the other coordinates. 

When a? + b? + ? = 1 and d < 0 in the equation ax + by + cz + d = 0, the 
equation is said to be in normal form. In this case —d is the distance of the plane to 
the origin, and (a,b, c) are the direction cosines of the normal. 

To reduce an arbitrary equation ax + by + cz + d = 0 to normal form, divide by 
«Va? + b? + с?, where the sign of the radical is chosen opposite the sign of d when 
d + 0, the same as the sign of c when d = 0 and c Z 0, and the same as the sign of 
b otherwise. 


4.12.1 PLANES WITH PRESCRIBED PROPERTIES 


1. Plane through (xo, yo, zo) and perpendicular to the direction (a, b, c): 


a(x — zo) + bly — yo) + c(z — 20) = 0. (4.12.2) 
2. Plane through (zo, yo, zo) and parallel to the two directions (a1,51,c1) and 
(аз, ba, со): 
21-20 У-%о0 2-90 
Q1 by C1 = 0. (4.12.3) 
аә b» C2 


3. Plane through (xo, yo, zo) and (x1, 11, 21) and parallel to the direction (а, b, с): 


2-10 Y-Y 2-9%0 
21-20 Yı— Yo 21-20|- 0. (4.12.4) 
а 5 с 


4. Plane going through (xo, yo, 20), (£1, Y1, 21), and (£2, Y2, 22): 


pow. 2-0 у = у 2-2 
1 = 40 — Yo 7- «0 
г. | » 1 = 0 or Tı — to Yyı— Yo 21 —20| = 0. 
1 1 1 
29-2 5 29--2 
жә 99 901 2 o 92-10 2 0 
(4.12.5) 


(The last three formulae remain true in oblique coordinates.) 


5. The distance from the point (Zo, yo, zo) to the plane ax + by + cz + d = 0 15 
azo + byo + czo + d 


(4.12.6) 
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6. The angle between two planes aox + boy + coz + do = 0 and aya + biy + 
суз + йу = 0 15 
E адал + bobi + сос\ 
Ма ES + с4а +518 
In particular, the two planes are parallel when ао : bo : со = a1 : by : сі, and 
perpendicular when aga; + боб + сос! = 0. 


COS (4.12.7) 


4.12.2 CONCURRENCE AND COPLANARITY 


Four planes agx4-6934-coz4-dg = 0, a1z--b1y--ciz4- di = 0, a3 +bosy +324 da = 
0, and a3x + bay + сз2 + da = 0 аге concurrent (share a point) if and only if 


= 0. (4.12.8) 
аз bs C3 аз 


Four points (zo, Yo, zo). (£1, 41,21), (£2, Y2, 22), and (x3, y3, 23) аге coplanar (Пе 
оп the same plane) if and only if 


To o 20 1 
11 Yi 21 1 

= 0. 4.12.9 
29 Y2 22 1 ( ) 


X3 3 23 1 
(Both of these assertions remain true in obligue coordinates.) 


4.13 LINES IN SPACE 


Two planes that are not parallel or coincident intersect in a straight line, such that 
one can express a line by a pair of linear eguations 


ax + by+cz+d=0 

ҚА +Ьу+сг+4 = 
such that bc’ — cb’, са! — ac’, and ab" — ba! are not all zero. The line thus defined is 
parallel to the vector (be! — cb, ca’ — ac’, ab" — ba"). The direction cosines of the line 
are those of this vector. See Equation (4.11.1). (The direction cosines of a line are 
only defined up to a simultaneous change in sign, because the opposite vector still 
gives the same line.) 

The following particular cases are important: 


(4.13.1) 


1. Line through (zo, уо, zo) parallel to the vector (a, b, c): 
1-10 Vy-UVyo 2? 20 


4.13.2 
а b с ( ) 
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2. Line through (zo, yo, zo) and (a1, y1, 21): 
BO) у И о... Ta (4.13.3) 
11 — 70 yı — Yo 21 — 20 
This line is parallel to the vector (xı — zo, y1 — Yo, 21 — 20). 


4.13.1 DISTANCES 


1. The distance between two points in space is the length of the line segment 
joining them. The distance between the points (То, yo, 20) and (21,11, 21) is 


(zi — х0)? + (41 — yo)? + (21 — 20)?. (4.13.4) 


2. The point k% of the way from Ро = (20, yo, zo) to Р, = (21,01, 21) is 
(28 + (100 — k)zo ky: + (100 —k)yo kzı + (100 — Эв) (4.13.5) 
100 | 100 : 100 S eee 
(The same formula also applies in obligue coordinates.) This point divides the 
segment PAP, in the ratio k : (100 — k). As a particular case, the midpoint of 
PoP, is given by 


(4.13.6) 


212520 Ytyo 21 + 20 
25587 2 ^" 2 \ 


3. The distance between the point (£o, yo, 20) and the line through (21, yi, 21) in 
direction (a, b, c): 


2 
20-21 90-01 
a 


2 

20-21 20-71 
с а 
а2--52--с2 


2 
Yo —Y1 20 21 
с 


+ + 


(4.13.7) 


4. The distance between the line through (2:0, yo, 20) in direction (ao, bo, Co) and 
the line through (21,41, 21) in direction (a1,b1, c1): 


21-20 Yı— yo 21-20 
ао bo Co 
a b с 
ы 1 : - (4.13.8) 
bo Co + Co ао + ао bo 
b ci бі a1 a by 
4.13.2 ANGLES 
Angle between lines with directions (tg, yo, zo) and (21,01, 21): 
bob 
it ызы. (4.13.9) 


In particular, the two lines are parallel when ao : bo : co = a4 : by : а, and 
perpendicular when aga, + бор + coci = 0. 
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Angle between lines with direction angles ag, до, уо and ал, 01,711: 


соя” "(сова cos a + cos бо cos f + cos уо cos ^1 ). (4.13.10) 


4.13.3 CONCURRENCE, COPLANARITY, PARALLELISM 


Two lines, each specified by point and direction, are coplanar if, and only if, the 
determinant in the numerator of Equation (4.13.8) is zero. In this case they are 
concurrent (if the denominator is non-zero) or parallel (if the denominator is zero). 

Three lines with directions (ao, bo, Co), (a1, b1, c1), and (ао, Бо, со) are parallel 
to a common plane if and only if 


ao bo co 
а bi а! = 0. (4.13.11) 
аә bə сә 


4.14 POLYHEDRA 


For any polyhedron topologically equivalent to a sphere—in particular, for any con- 
vex polyhedron—the Euler formula holds: 

v—e+f2—2, (4.14.1) 
where v is the number of vertices, e is the number of edges, and f is the number of 
faces. 

Many common polyhedra are particular cases of cylinders (Section 4.15) or 
cones (Section 4.16). A cylinder with a polygonal base (the base is also called a 
directrix) is called a prism. A cone with a polygonal base is called a pyramid. A 
frustum of a cone with a polygonal base is called a truncated pyramid. Formu- 
lae (4.15.1), (4.16.1), and (4.16.2) give the volumes of a general prism, pyramid, and 
truncated pyramid. 

A prism whose base is a parallelogram is a parallelepiped. The volume of a 
parallelepiped with one vertex at the origin and adjacent vertices at (x1, 41, 21), 
(£2, ya, 22), and (x3, ys, 23) is given by 


Xi yi 4 
volume = |x3 Y2 25|. (4.14.2) 
їз Ууз 23 


The rectangular parallelepiped is a particular case: all of its faces are rectangles. If 
the side lengths are а, b, c, the volume is abc, the total surface area is 2(ab + ac + be), 
and each diagonal has length Va? + b? + c?. When a = b = c we get the cube. See 
Section 4.14.1. A pyramid whose base is a triangle is a tetrahedron. The volume 
of a tetrahedon with one vertex at the origin and the other vertices at (2 1,11, 21), 
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(22, y2; 22), and (x3, Уз. 23) is given by 
117: л 21 
volume = — |29 49 25|. (4.14.3) 
23 Уз 23 
In a tetrahedron with vertices Po, РІ, P2, P5, let dj; be the distance (edge length) 
from Р, to P;. Form the determinants 
0 1 1 1 1 
1 0 dy dj dj 
А=|1 Sy 0 da di and T= 
1 d di; 0 4 
1 фа da d» 0 
Then the volume of the tetrahedron is v/ (Д|/288, and the radius of the circumscribed 
sphere is 34/|V/2A |. 
Expanding the determinant we find that the volume V satisfies the formula: 
144V? = — dô, di; doz а dii 413403 T 41,415; = dô2do3d>3 
+ dj; doa di + 44,444; + 400415405 + di2d02d03 
+ 503003 + do2disdos + 40141245 + 401 402433 
+ doi dia d35 + %,41;%; + %,40,%; + 41240345: (4.14.5) 
— dôzdozdi s — 40:41:43 
- 41;41;%ҙ - didis dos 
- 41443 - 44433. 
(Mnemonic: Each of the first four negative terms corresponds to a closed path around 
a face; each positive term to an open path along three consecutive edges; each re- 
maining negative term to a pair of opposite edges with weights 2 and 1. All such 
edge combinations are represented.) 
For an arbitrary tetrahedron, let P be a vertex and let a, b, c be the lengths of the 
edges converging on Р. If A, В, С are the angles between the same three edges, the 
volume of the tetrahedron is 


1 
V= вабсу 1 — cos? A — cos? B — cos? С + 2с08Асо8Всов8С. (4.14.6) 


0 dı doz djs 
dj, 0 dis di, 
d» di; 0 dX» 
Фа di; di, 0 


(4.14.4) 


4.14.1 CONVEX REGULAR POLYHEDRA 


Figure 4.35 shows the five regular polyhedra, or Platonic solids. In the following 
tables and formulae, a is the length of an edge, 0 the dihedral angle at each edge, R 
the radius of the circumscribed sphere, r the radius of the inscribed sphere, V the 
volume, S the total surface area, v the total number of vertices, e the total number of 
edges, f the total number of faces, p the number of edges in a face (3 for equilateral 
triangles, 4 for squares, 5 for regular pentagons), and g the number of edges meeting 
at a vertex. 
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FIGURE 4.35 
The Platonic solids. Top: the tetrahedron (self-dual). Middle: the cube and the octahedron 


(dual to one another). Bottom: the dodecahedron and the icosahedron (dual to one another). 


v © 
Є © 


_1 €os(180? /g) 


0- R 180° 180° 
sin(180°/p)’ — — tan tan ; 
Бо ў r q 
ш- 1. S foa а (4447) 
а sin(180°/p) cos 560 124 p` 
ЕНЕСІ V= irs 
a 


Regular tetrahedron 70°31'44" 


Cube 90° 

Regular octahedron 109°28'16” 
Regular dodecahedron 116?33'54" 
Regular icosahedron 138?11'23" 


© 2003 by СКС Press LLC 


Tetrahedron У6/4 0.612372 V6/12 0.204124 
Cube У3/2 0.866025 i 0.5 


2 
Octahedron v2/2 0.707107 У6/6 0.408248 
Dodecahedron | $(V15+ V3) 1.401259 | 35v 250 + 1105 1.113516 
1 
4 


Icosahedron 


V10+ 2v5 0.951057 5 V 42+ 18/5 0.755761 


Tetrahedron V3 1.73205 V2/12 0.117851 
Cube 6 6. 1 1. 

Octahedron 2/3 3.46410 V2/3 0.471405 
Dodecahedron 34/25--10у5 20.64573 1(15 + 7V5) 7.663119 
Icosahedron 5V3 8.66025 5(3+ v5) 2.181695 


4.14.2 POLYHEDRA NETS 


Nets for the five Platonic solids are shown: a) tetrahedron, b) octahedron, c) icosa- 
hedron, d) cube, and e) dodecahedron. Paper models can be made by making an 
enlarged photocopy of each, cutting them out along the exterior lines, folding on the 
interior lines, and using tape to join the edges. 


| A Ň VASA 


(с) 


(4) (е) 
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FIGURE 4.36 
Left: ап obligue cylinder with generator L and directrix С. Right: a right circular cylinder. 


L 


4.15 CYLINDERS 


Given a line L and a curve С in a plane Р, the cylinder with generator L and directrix 
С is the surface obtained by moving L parallel to itself, so that a point of L is always 
on С. If L is parallel to the z-axis, the surface’s implicit equation does not involve 
the variable z. Conversely, any implicit equation that does not involve one of the 
variables (or that can be brought to that form by a change of coordinates) represents 
a cylinder. 

If С is a simple closed curve, we also apply the word cylinder to the solid en- 
closed by the surface generated in this way (Figure 4.36, left). The volume contained 
between P and a plane Р” parallel to P is 


V = Ah = Al sin6, (4.15.1) 


where A is the area in the plane P enclosed by C, h is the distance between Р and Р” 
(measured perpendicularly), / 15 the length of the segment of L contained between 
P and Р”, and 0 is the angle that L makes with P. When 0 = 90° we have a right 
cylinder, and h = 1. For a right cylinder, the lateral area between P and Р! is hs, 
where s is the length (circumference) of С. 

The most important particular case is the right circular cylinder (often simply 
called a cylinder). If r is the radius of the base and h is the altitude (Figure 4.36, 
right), the lateral area is 2ттһ, the total area is 2rr(r + h), and the volume is zr? h. 
The implicit equation of this surface can be written r“ + y? = r?; see also page 364. 


4.16 CONES 


Given a curve С in a plane P and a point О not in Р, the cone with vertex О and 
directrix С is the surface obtained as the union of all rays that join О with points 
of С. If О is the origin and the surface is given implicitly by an algebraic equation, 
that equation is homogeneous (all terms have the same total degree in the variables). 
Conversely, any homogeneous implicit equation (or one that can be made homoge- 
neous by a change of coordinates) represents a cone. 
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FIGURE 4.37 
Top: a cone with vertex O and directrix C. Bottom left: a right circular cone. Bottom right: 
A frustum of the latter. 


If C is a simple closed curve, we also apply the word cone to the solid enclosed 
by the surface generated in this way (Figure 4.37, top). The volume contained be- 
tween P and the vertex O is 

V = 34h, (4.16.1) 


where A is the area in the plane Р enclosed by С and h is the distance from O and 
P (measured perpendicularly). 

The solid contained between Р and a plane Р” parallel to Р (on the same side 

of the vertex) is called a frustum. It’s volume is 

V = 3M A + A + V AA!), (4.16.2) 
where А and A’ are the areas enclosed by the sections of the cone by P and Р” (often 
called the bases of the frustum), and Л is the distance between P and Р”. 

The most important particular case of a cone is the right circular cone (often 
simply called a cone). If r is the radius of the base, h is the altitude, and [15 the 
length between the vertex and a point on the base circle (Figure 4.37, bottom left), 
the following relationships apply: 


= М2 +1, 
Lateral area = пті = aryr? +R, 
Total area = Tr(l +r) = ar(r + Vr? + h2), and 
Volume = Lzr?h. 


3 


The implicit equation of this surface can be written x? + y? = 2°; see also Sec- 
tion 4.18. 
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For a frustum of a right circular cone (Figure 4.37, bottom right), 
{= \/ са th, 
Lateral area = z (r4 + r2)l, 
Total area = n(ri +73 + (rı +r2)l), and 


Volume = &тЮ(гү + r5 + riro). 


4.17 SURFACES OF REVOLUTION: THE TORUS 


A surface of revolution is formed by the rotation of a planar curve C about an axis in 
the plane of the curve and not cutting the curve. The Pappus—Guldinus theorem says 
that: 


1. The area of the surface of revolution on a curve С is equal to the product of 
the length of С and the length of the path traced by the centroid of С (which 
is 27 times the distance from this centroid to the axis of revolution). 


2. The volume bounded by the surface of revolution on a simple closed curve С 
is equal to the product of the area bounded by C and the length of the path 
traced by the centroid of the area bounded by С. 


When C is a circle, the surface obtained is a circular torus or torus of revolution 
(Figure 4.38). Let r be the radius of the revolving circle and let R be the distance 
from its center to the axis of rotation. The area of the torus is 47 ? Rr, and its volume 
is 27? Rr?. 


FIGURE 4.38 


A torus of revolution. 


ч О» 
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4.18 QUADRICS 


A surface defined by an algebraic eguation of degree two is called a guadric. Spheres, 
circular cylinders, and circular cones are guadrics. By means of a rigid motion, any 
quadric can be transformed into a quadric having one of the following equations 
(where а, b,c 4 0): 


. Real ellipsoid: 

. Imaginary ellipsoid: 

. Hyperboloid of one sheet: 

. Hyperboloid of two sheets: 
. Real quadric cone: 


а? Ја? + y? [02 + 22/2 = 1 
а? /а? + y?/b? + 2? [е = —1 
а? Ја? + y? [B — 22е? = 1 
а? Ја? +y? [02 — 2? [е = —1 
ж? fa? + у? [pP 22е? — D 


. Imaginary quadric cone: 

. Elliptic paraboloid: 

. Hyperbolic paraboloid: 

. Real elliptic cylinder: 

. Imaginary elliptic cylinder: 


1? Ја? +y?/b? + 27/2 = 0 
а? Ја? +1? [2 + 22 = 0 

а? Ја? — y? [2 + 22 2 0 
алуа + y? /b? = 1 

а Ја? + y? /b? = —1 


Шина 
мо л О-о Боо мыо н 


. Hyperbolic cylinder: x? /a? — у?/Ь? = 1 
. Real intersecting planes: 2? ја? —y? /b> = 0 
. Imaginary intersecting planes: 22/42 + y? /b> = 0 
. Parabolic cylinder: а? +2y = 0 

. Real parallel planes: g^ 

. Imaginary parallel planes: j tees 

‚ Coincident planes: т? =0 


Surfaces with Eguations 9—17 are cylinders over the plane curves of the same 
eguation (Section 4.15). Eguations 2, 6, 10, and 16 have no real solutions, so that 
they do not describe surfaces in real three-dimensional space. A surface with Egua- 
tion 5 can be regarded as a cone (Section 4.16) over a conic C (any ellipse, parabola, 
or hyperbola can be taken as the directrix; there is a two-parameter family of essen- 
tially distinct cones over it, determined by the position of the vertex with respect to 
C). The surfaces with Equations 1, 3, 4, 7, and 8 are shown in Figure 4.39. 

The surfaces with Equations 1—6 are central quadrics; in the form given, the 
center is at the origin. The quantities a, b, c are the semi-axes. 

The volume of the ellipsoid with semi-axes a, b,c is атабс. When two of the 
semi-axes are the same, we can also write the area of the ellipsoid in closed-form. 
Suppose b = c, so the ellipsoid x? /a? + (y? + z?) /b? = 1 is the surface of revolution 
obtained by rotating the ellipse x“ /a? + 2/02 = 1 around the x-axis. Its area is 

27b“ + Ён sin“) a= = 2тЬ? + „л. log Каш. = 
ма? — b? a b? — až b— Vb? E T 


The two quantities are equal, but only one avoids complex numbers, depending on 
whether a > b or a < b. When a > b, we have a prolate spheroid, that is, an ellipse 
rotated around its major axis; when a « b we have an oblate spheroid, which is an 
ellipse rotated around its minor axis. 
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Given a general guadratic eguation in three variables, 
ax? + by? + cz? +2 fyz + 2gzx + 2hzy + 2рх + 2gy + 2rz + а = 0, (4.18.2) 


one can determine the type of conic by consulting the table: 


Un [3 TE ins [rss Гега 


Real ellipsoid 

Imaginary ellipsoid 
Hyperboloid of one sheet 
Hyperboloid of two sheets 
Real quadric cone 
Imaginary quadric cone 
Elliptic paraboloid 
Hyperbolic paraboloid 
Real elliptic cylinder 
Imaginary elliptic cylinder 
Hyperbolic cylinder 

Real intersecting planes 
Imaginary intersecting planes 
Parabolic cylinder 

Real parallel planes 
Imaginary parallel planes 
Coincident planes 


A 


А 
3 
3 
3 
3 
2 
2 
2 
2 
2 
2 
2 
1 
1 
1 
1 


— оошо М Мэ шо U RP > шо U RBR 


The columns have the following meaning. Let 


Ч | and Е- 
g с 


Let рз and рд be the ranks of е and Е, and let A be the determinant of E. The 
column “k signs" refers to the non-zero eigenvalues of e, that is, the roots of 


f 
A (4.18.3) 
T 


a зю З 


a h 
h b 
9 f 
p q 


а-т h g 
h 5-2 f |-0; (4.18.4) 
4 ) c—a 
if all non-zero eigenvalues have the same sign, choose "same", otherwise "opposite". 
Similarly, “К signs" refers to the sign of the non-zero eigenvalues of Е. 


4.18.1 SPHERES 


The set of points in space whose distance to a fixed point (the center) is a fixed 
number (the radius) is a sphere. A circle of radius r and center (£o, yo, zo) is defined 
by the equation 

(z — z0)” + (y — yo)“ + (z — zo)“ = r^, (4.18.5) 
ог 


т? ty? + 2? — 2x79 — 2yyo — 2220 + 32 + y? + 22 -r = 0. (4.18.6) 
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FIGURE 4.39 

The ve non-degenerate real guadrics. Top left: ellipsoid. Top right: hyperboloid of two 
sheets (one facing up and one facing down). Bottom left: elliptic paraboloid. Bottom middle: 
hyperboloid of one sheet. Bottom right: hyperbolic paraboloid. 


Conversely, an equation of the form 
т? ty? +27 + 24х + 2ey +2fzt+g=0 (4.18.7) 
defines a sphere if d? + e? + f? > g: the center is (—d, —e, — f) and the radius is 


v d? +e? + f? — g. 


1. Four points not in the same plane determine a unigue sphere. If the points 
have coordinates (11,41, 21), (2, ys, 22), (T3,Y3, 23), and (x4, Ta, 24), the 
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FIGURE 4.40 
Left: a spherical cap. Middle: a spherical zone (of two bases). Right: a spherical segment. 


equation of the sphere is 

22-92-22 z y z 
L tyt? 21 y Z 
15 yz) ďa уз Za (4.18.8) 


214,242 
13 + Y3 t 23 173 уз 2з 


ні ҥн eS Se 
Il 
© 


а2 +2 + 22 Ta Va ZA 

2. Given two points Р, = (21,11,21) and Р» = (x2, ye, 22), there is a unique 
sphere whose diameter is Pı P»; its equation is 

(ж — x1)(x — 29) + (y — 1л)(у — y2) + (z — z1 )(z 22) = 0. (4.18.9) 


3. The area of a sphere of radius r is 4тт?, and the volume is Arr?. 


4. The area of a spherical polygon (that is, of a polygon on the sphere whose 
sides are arcs of great circles) is 


8- (5:% 5 (n —2)т}г?, (4.18.10) 


where r is the radius of the sphere, n is the number of vertices, and 0; are 
the internal angles of the polygons in radians. In particular, the sum of the 
angles of a spherical triangle is always greater than r — 180“, and the excess 
1s proportional to the area. 


4.18.1.1 Spherical cap 


Let the radius be r (Figure 4.40, left). The area of the curved region is 27rh = rp“. 
The volume of the cap is 37h? (3r — h) = т Қ3а? + 12). 


4.18.1.2 Spherical zone (of two bases) 


Let the radius be r (Figure 4.40, middle). The area of the curved region (called a 
spherical zone) is 2ттҺ. The volume of the zone is enh(3a? + 302 + А2). 
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4.18.1.3 Spherical segment апа lune 


Let the radius be r (Figure 4.40, right). The area of the curved region (called a 
spherical segment or lune) is 2720, the angle being measured in radians. The volume 
of the segment is $736. 


4.18.1.4 Volume and area of spheres 


If the volume of an n-dimensional sphere of radius r is V, (r) and its surface area is 
Sn (r), then 
2717 277/211  т"/?ү" 
V, (r) = - Vn—2(r) = 


| лГ(2)  (8!' (4.18.11) 
$,(r) = ТУ (е) = E09]. 


Hence, the area of a circle is V, = тт? ss 3.141677, the volume of a 3-dimensional 
sphere is V3 = inr? zz 4.188873, the volume of a 4-dimensional sphere is V, = 
irn ду 4.9348r^, the circumference of a circle is 55 = 27, and the surface area 
of a sphere is 53 = 47r?. 


For large values of n, 


once 


V (r) ғ т (Әлеу r". (4.18.12) 


4.19 SPHERICAL СЕОМЕТНҮ % TRIGONOMETRY 


The angles іп а spherical triangle do not have to add up to 180 degrees. It is possible 
for a spherical triangle to have 3 right angles. 


4.19.1 RIGHT SPHERICAL TRIANGLES 


Let a, b, and c be the sides of a right spherical triangle with opposite angles A, B, 
and C, respectively, where each side is measured by the angle subtended at the center 
of the sphere. Assume that С = 7/2 = 90° (see Figure 4.41, left). Then, 


sina = tan bcot В = sin Asinc, cos A = tan b cot c = cosa sin В, 
sinb = tana cot A = sin B sinc, cos B = tan a cot с = cosb sin A, 
cosc = соз А cot B = cosa cosb. 


4.19.1.1 Napier’s rules of circular parts 


Arrange the five quantities a, b, co-A (this is the complement of A), со-с, co-B 
of a right spherical triangle with right angle at С, in cyclic order as pictured in 


© 2003 by CRC Press LLC 


FIGURE 4.41 
Right spherical triangle (left) and diagram for Napier’s rule (right). 


Figure 4.41, right. If any one of these quantities is designated a middle part, then 
two of the other parts are adjacent to it, and the remaining two parts are opposite to 
it. The formulae above for a right spherical triangle may be recalled by the following 
two rules: 


1. The sine of any middle part is equal to the product of the tangents of the two 
adjacent parts. 

2. The sine of any middle part is equal to the product of the cosines of the two 
opposite parts. 


4.19.1.2 Rules for determining quadrant 


1. A leg and the angle opposite to it are always of the same quadrant. 
2. If the hypotenuse is less than 90°, the legs are of the same quadrant. 
3. If the hypotenuse is greater than 90°, the legs are of unlike quadrants. 


4.19.2 OBLIQUE SPHERICAL TRIANGLES 


In the following: 


а, b, c represent the sides of any spherical triangle. 

A, B, C represent the corresponding opposite angles. 

a’, b', c', A', B', С! are the corresponding parts of the polar triangle. 
s = (a +b + c)/2. 

S = (A + B + C)/2. 

A is the area of spherical triangle. 

E is the spherical excess of the triangle. 


e 
е 
е 
е 
е 
е 
е 
e R is the radius of the sphere upon which the triangle lies. 
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0? <a+b+c < 360°, 
Е= А+В+С – 180°, 


4.19.2.1 


В = 180° — V, C= 


b = 180? — В’, 


Spherical law of sines 


sina sin b sinc 


sin4 sinB snlC 


4.19.2.2 Spherical law of cosines for sides 
cos a = cos b cosc + sin bsin c cos A, 


cos b = cos ccosa + sin csin a cos В, 


cosc = cosa cosb + sina sin b cos С. 


4.19.2.3 Spherical law of cosines for angles 


cos А = — cos B cos С + sin B sin С cosa, 


cos B = — cos С соз А + sin C sin A cosb, 


cos C = — cos А cos B + sin Asin В cosc. 


4.19.2.4 Spherical law of tangents 


tan$(B— C) _ {ап+(ф—с) 
хап В+С)  tani(bc c) 
{ап (С — A)  tanš(c — a) 
tan 3(C + А)  tani(c-a)' 
tan$(A— B) бап 5(а — b) 
tan3(4+B) tanž(a +0) 


4.19.2.5 Spherical half angle formulae 


Define k“ = (tan r)“ = 
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sin(s — a) sin(s — b) sin(s — c) 


sins 


. Then 


180° < A+ B +С < 540°, 
A = 7R“E/180. 


) S k 
— sin(s — a)" 
B k 


4.19.2.6 Spherical half side formulae 
2 2 — cos S 
pense сийн cos(S — A) cos(S — В) cos(S — C): а 
tan(a/2) = К cos(S — A), 
tan(b/2) = K cos(S — B), (4.19.2) 
tan(c/2) = K cos(S — C). 


4.19.2.7 Gauss's formulae 


sin 3 (a — b) ш sin (A — B) cos $(a — b) _ sin $(A + B) 
sin $c cos$C ” cos $c cos3C ^" 

sin $(a + b) _ cos $(A — B) cos $(a + b) т cos $(A + B) 
sin $c siniC  ' cos $c sin $C 


4.19.2.8 Napier’s analogs 


sin $(A — B) 2 tan 3 (a — b) sin 3 (a — b) = tan (A — B) 
зш (А+ B) tanic " sin $(a + b) cotiC ' 
cosi(A— B)  tan£(a-b) cosi(a— b) бап 5(А+ B) 
со84(4-8) _ tanje ^ cosi(a--b) ^ cotiC 


4.19.2.9 Rules for determining quadrant 
1. f A» B>C,thena > b > c. 
2. A side (angle) which differs by more than 90° from another side (angle) is in 
the same guadrant as its opposite angle (side). 
3. Half Ше sum of any two sides and half the sum of the opposite angles are in 
the same guadrant. 
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4.19.2.10 Summary of solution of obligue spherical triangles 


ае тае 
Three angles Half-side formulae 


Two sides and Napier 8 analogies (to find sum and difference | Gauss's 

included angle | of unknown angles); then law of sines (to find | formulae 
remaining side). 

Two angles and | Napier’s analogies (to find sum and difference | Gauss’s 

included side of unknown sides); then law of sines (to find formulae 
remaining angle). 

Two sides and Law of sines (to find an angle); then Napier’s Gauss’s 

an opposite analogies (to find remaining angle and side). formulae 

angle Note the number of solutions. 

Two angles and | Law of sines (to find a side); then Napier’s Gauss's 

an opposite side | analogies (to find remaining side and angle). formulae 
Note the number of solutions. 


4.19.2.11 Haversine formulae 
1 — cosa 229 
hava = ясан = sin 


= hav(b — с) + sin b sin chav A. 


sin(s — b) sin( s — c) 


NIS 


, 


hav A = - - 
sin bsine 
_ hava — hav(b — c) 


, 


sinbsinc 
= hav[180° — (B + C)] + sin B sin C hava. 


4.19.2.12 Finding the distance between two points on the earth 
To find the distance between two points on the surface of a spherical earth, let point 
Р, have a (latitude, longitude) of (01,01) and point P» have a (latitude, longitude) 
of (фо, 05). Two different computational methods are as follows: 


1. Let A be the North pole and let В and C be the points Рі and P». Then the 
spherical law of cosines for sides gives the central angle, a, subtended by the 
desired distance: 

cos(a) = cos(b) cos(c) + sin(b) sin(c) cos( A) 
where the angle А is the difference in longitudes, and b and c are the angles of 


the points from the pole (i.e., 90?— latitude). Scale by Rg (the radius of the 
earth) to get the desired distance. 


2. In (x,y, z) space (with +z being the North pole) points P; and P are repre- 
sented as vectors from the center of the earth in spherical coordinates: 


vi = [Re cos(¢1) cos(01) Re cos(¢1) sin(@1) Re sin(¢1)] , 


| | (4.19.3) 
v2 = [Re сов(фә) cos(@2) Re сов(фә) sin(92) Re sin(¢2)] - 
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The angle between these vectors, a, is given by 


(sas A LM 2и = соз(Ф1) соз(фә) cos(91 — 02) + sin($1) віп(фә) 
[у — R$ 


= 2tan ! 4/ —— 
tan = 


where b = sin“ (252) + соз(ф1) сов(фэ) sin“ (2122). (The formula using 


b is more accurate numerically when Рі and Р, are close.) The great circle 
distance between P, and P; is then Raa. 


EXAMPLE The angle between Frew York with (61 = 40.78°, 61 = 73.97?) and Preijing 
with (фә = 39.93°, 62 = 243.58“) is а = 98.8“. Using Rẹ = 6367 the great circle 
distance between New York and Beijing is about 11,000 km. 


4.20 DIFFERENTIAL GEOMETRY 


4.20.1 CURVES 
4.20.1.1 De nitions 


1. A regular parametric representation of class С”, k > 1, is a vector valued 
function Ё: I + R“, where I С R is an interval that satisfies (1) f is of class 
CF (i.e., has continuous k" order derivatives), and (ii) f'(£) 3 0, for all t 1. 
In terms of a standard basis of К, we write x = f(t) = (fi(t), fo(t), fa(t)). 
where the real valued functions f;, i = 1, 2, 3 are the component functions of f. 


2. An allowable change of parameter of class С is any С” function © : J > I, 
where J is an interval and $(J) C J, that satisfies ф (т) Z 0, for all r € J. 


3. А СЕ regular parametric representation f is equivalent to a С" regular para- 
metric representation g if and only if an allowable change of parameter ¢ exists 
so that Ф(1,) = Ip, and g(r) = f(ó(T)), for all т € I,. 


4. A regular curve C of class С" is an equivalence class of С“ regular parametric 
representation under the equivalence relation on the set of regular parametric 
representations defined above. 


5. The arc length of any regular curve C defined by the regular parametric repre- 
sentation f, with If = [a,b], is defined by 


b 
L- | ІР(ш)| du. (4.20.1) 


An arc length parameter along С is defined by 


t 
s = a(t) = + 1 | (u)| du. (4.20.2) 
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The choice of sign is arbitrary and c is any number in Гу. 


6. A natural representation of class C* of the regular curve defined by the regular 
parametric representation f is defined by g(s) = f(a ^ (s)), for all s € [0, Z]. 


7. А property of a regular curve C is any property of a regular parametric rep- 
resentation representing С which is invariant under any allowable change of 
parameter. 


8. Let g be a natural representation of a regular curve С. The following quantities 
may be defined at each point x = g(s) of С: 


Binormal line y = Ab(s) + x 
Curvature к(в) = n(s) - k(s) 
Curvature vector k(s) = t(s) 
Moving trihedron {t(s),n(s), b(s)} 
Normal plane (у — х) -t(s) 20 
Osculating plane (у —x)-b(s) 20 
Osculating sphere (у—с)-(у—с) =r? where 
c =x + p(s)n(s) — Шш s)/(&?(s)r(s)))b(s) 


Principal normal line 

Principal normal unit 
vector 

Radius of curvature 

Rectifying plane 

Tangent line 

Torsion 

Unit binormal vector 


Unit tangent vector 


y = An(s) + x 

n(s) = +k(s)/|k(s)|, for k(s) Z 0 defined to be 
continuous along C 

p(s) = 1/ |к(в)|, when (s) 40 

(y —x) d =0 

y = At(s) + 

т(8) = —n(s j: b(s) 

b(s) — A ) x n(s) 


t(s) = g(s) with (a(s) = а) 


4.20.1.2 Results 


The arc length L and the arc length parameter s of any regular parametric represen- 
tation f are invariant under any allowable change of parameter. Thus, L is a property 
of the regular curve C defined by f. 

The arc length parameter satisfies йв = = a(t) = + 140) 
КЕ )| = = 1, if and only if ¢ is an arc | parameter. Thus, arc length parameters 
are uniquely determined up to the transformation s — 8 = +s + 50, where sg is any 
constant. 

The curvature, torsion, tangent line, normal plane, principal normal line, recti- 
fying plane, binormal line, and osculating plane are properties of the regular curve 
C defined by any regular parametric representation f. 

If x = f(t) is any regular representation of a regular curve С, the following 
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results hold at point f(t) of С: 
х : (x" x x") 
k| = ———, T2——:—. (4.20.3) 
| | (ә |x’ x x! |? 
The vectors of the moving trihedron satisfy the Serret-Frenet equations 
{= Kn, а = —kt-4 Tb, b-- (4.20.4) 


For any plane curve represented parametrically by x — ic = 6, f(1),0), 


(4.20.5) 


Expressions for the curvature vector and curvature of a plane curve corresponding to 
different representations are given in the following table: 


_ Curvature vector k Curvature, |к| = p^! 
Яс [ti — 02| 
у= d і 22 | 02)3/2 


o o 


(г? + 21!“ f sin — r cos, r? +21!“ — rr" 
рр 2 зэ. 2 4 112 )8/2 


E Tr 3 Uh? 


The equation of the osculating circle of a plane curve is given by 
(у—<)-(у—с)=р”, (4.20.6) 
where с = x + p?k is the center of curvature. 


THEOREM 4.20.1 (Fundamenial existence and unigueness theorem) 


Let к(в) апа т(в) be any continuous functions de ne d for all s € [a,b]. Then there 
exists, up to a congruence, a unigue space curve C for which k is the curvature 
function, T is the torsion function, and s an arc length parameter along C. 


4.20.1.3 Example 


A regular parametric representation of the circular helix is given by x = f(t) = 
(a cos t, a sin t, bt), for all t € R, where a > 0 and b 5 0 are constant. By successive 
differentiation, 


x = (—asint, acost,b), 

x" = (—a cost, —a sint, 0), (4.20.7) 
x" = ( asint,—acost,0), 

so that 4 = [x] = Va? + 02. Hence, 


1. Arc length parameter: s = a(t 


— t(a 3 
2. Curvature vector: k = St = Ф = (a? + 02) (—a cost, —a sin t, 0) 
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3. Curvature: k = |k| = a(a? + b?)7! 
4. Principal normal unit vector: n = k/ |К| = (— cost, — sint, 0) 
5. Unit tangent vector: t — ET = (a? + b?)7ž(—a sint,a cost, b) 
6. Unit binormal vector: 
р = хп = (а? + 02) 3 (bsin t, bcost, a) 
b= 22 = b(a? + 02)! (cost, sin t, 0) 
7. Torsion: т = —n- b = b(a? + b2)—! 


The values of |к| and т can be verified using the formulae in (4.20.3). The sign of 
(the invariant) т determines whether the helix is right handed, т > 0, or left handed, 
T < 0. 


4.20.2 SURFACES 
4.20.21 Definitions 


1. A coordinate patch of class С", k > 1 on a surface S С IR? is a vector valued 
function f : U — S, where U c R? is an open set, that satisfies (i) f is 
class C* on U, (ii) ZE(u,v) x A(u,v) F 0, for all (u, v) € U, and (iii) f is 
one-to-one and bi-continuous on U. 


2. In terms of a standard basis of R? we write x = f(u,v) = (fı (u,v), fo(u,v), 
f3(u,v)), where the real valued functions { f1, f2, f3} are the component func- 
tions of f. The notation x1 = X, = X. =x, = 2 1 


$5 uu = v, 1s 
freguently used. 


Өш? 
3. A Monge patch is a coordinate patch where f has the form f(u,v) = 
(u,v, f(u,v)), where f is a real valued function of class C'*. 


4. The u-parameter curves v = vo on 5 are the images of the lines v = vo in U. 
They are parametrically represented by x — f(u, vo). The v-parameter curves 
и = ug are defined similarly. 


5. An allowable parameter transformation of class С” is a one-to-one function 
$:U > V,where U,V C R° are open, that satisfies 


#0, (4.20.8) 
oe (u, v) до zv) 

for all (u,v) € U, where the real E functions, ©! and ф?, defined by 
dolu, v) = (ФЧи,0), Ф (и,0)) are the ры functions s ф. One may 


also write the parameter transformation as à! = $! (ul ,u?), à? = ф2 (ul ,u?). 


6. A local property of surface S is any property of a coordinate patch that is 
invariant under any allowable parameter transformation. 


7. Let f define a coordinate patch on a surface S. The following quantities may 
be defined at each point x — f(u, v) on the patch: 
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Asymptotic direction 
Asymptotic line 


Dupin’s indicatrix 
Elliptic point 


First fundamental form 


First fundamental metric 
coef cients 


Fundamental differential 


Gaussian curvature 


Geodesic curvature vector of 
curve С on S through x 


Geodesic оп S 
Hyperbolic point 


Line of curvature 


Mean curvature 


Normal curvature in the 
du : dv direction 


Normal curvature vector of 
curve С on S through « 

Normal line 

Normal vector 

Parabolic point 

Planar point 

Principal curvatures 


Principal directions 


Second fundamental form 


Second fundamental metric 
coef cients 
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A direction du : du for which к, = 0 


A curve on S whose tangent line at each point 
coincides with an asymptotic direction 

ez? + 2fzizo + 443 =: 

eg — f^ > 0 

I = dx - dx = gag(u,v) du? du? 
= E(u,v) du? + 2F(u, v) du dv + G(u,v) dv? 
E(u,v) = gı (u,v) = xi: xi 
F(u,v) = gis(u,v) = xi + xo 
G(u,v) = goo(u,v) = xa · Xo 

dx = Xa du“ = X, du + x, dv (a repeated upper 
and lower index signifies a summation over the 
range a = 1,2) 

eg- f’ 

EG — F? 

k, =k — (k-n)n = [ü^ + Г9 úžú7]xa where 
Гв, denote the Christoffel symbols of the 
second kind for the metric gag, defined in 
Section 5.10 

A curve on S which satisfies k, = 0 at each point 

eg—f? «0 

A curve on S whose tangent line at each point 
coincides with a principal direction 

kı +k2  gE-cteG-2fF 


K = кікә = 


H = 


2 О(ЕО-Е?) 
II 
=k-n=— 
kn n= 7 
k, = (k-n)n 
y=AN +x 


N = х„ хх, 
eg — f? = 0 not all of e, f,g = 0 
e=f=g=0 
The extreme values кі and кә of Ко, 
The perpendicular directions du : dv in which к, 
attains its extreme values 
II = —dx - dn = bag(u,v) du? du? 
= e(u,v) du? + 2f (u,v) du dv + g(u, v) dv? 
e(u,v) = bi1(u,v) = xu: n 
flu,v) = bis(u,v) = X12 n 
g(u,v) = bs» (u,v) = X22 n 


Tangent plane (у = х): N = 0, 0 y =X + Ах, + их, 


; Xu X Xy 
Unit normal vector = 0 
Ix, хх, | 
Umbilical point Kn = constant for all directions du : dv 


4.20.2.2 Results 
1. The tangent plane, normal line, first fundamental form, second fundamental 


form, and all derived quantities thereof are local properties of any surface S. 


2. The transformation laws for the first and second fundamental metric coeffi- 
cients under any allowable parameter transformation are given respectively by 


кун ди? Qu? апа 54-28 ди? Bu? 
бад = 98 Da 008° о8 7736 до 009 


Thus gag and bag are the components of type (0, 2) tensors. 


(4.20.9) 


3. I > 0 for all directions du : dv; I = 0 if and only if du = dv = 0. 


4. The angle 9 between two tangent lines to S at x = f(u,v) defined by the 
directions аш: dv and ди: dv is given by 
дав du? óu? 
(Jag du“ du?) 2 (бовбие®бий)% i 
The angle between the u-parameter curves and the v-parameter curves is given 
by cos = F(u,v)/(E(u,v)G(u,v))2. The u-parameter and v-parameter 
curves are orthogonal if and only if F (u,v) = 0. 


cos = (4.20.10) 


5. The arc length of a curve C on S, defined by x = f(u!(t), už(t)), with a < 
t < b, is given by 


b 
— | das (u! (t), и? (t)jù ùs dt (4.20.11) 


b 
= | VE), v(t))ü? 4 2Е (000), 000) 49 + Gul), ve? dt. 


6. The area of S — f(U) is given by 


А = ! det(gas(u!,už)) du! du? 


A y E(u, v)Glu, v) — F? (u,v) du dv. 
U 


(4.20.12) 


7. The principal curvatures are the roots of the characteristic equation, det(b 44 — 
Agag) = 0, which may be written as A? — bagg® A + b/g = 0, where g^? is 
the inverse of gag, b = det(ba g), and g = det(gag). The expanded form of 
the characteristic equation is 


(EG — Е?)А? – (eG —2fF + gE)A + eg — f? =0. (4.20.13) 
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13. 


14. 


15. 
16. 


. The principal directions du : dv are obtained by solving the homogeneous 


equation, 
biad25 du“ du“ — 022918 du? duf = 0, (4.20.14) 


or 


(eF — f E) du? + (eG — gE) du du + (fG — gF) dv? =0. (420.15) 


‚ Rodrigues formula: du : dv is a principal direction with principal curvature к 


if, and only if, dN + ках = 0. 


. A point x = f(u,v) on S is an umbilical point if and only if there exists a 


constant k such that bag (u, v) = kgag(u, v). 


. The principal directions at x are orthogonal if x is not an umbilical point. 


. The u- and v-parameter curves at any non-umbilical point x are tangent to 


the principal directions if and only if f(u,v) = F(u,v) = 0. If f defines a 
coordinate patch without umbilical points, the u- and v-parameter curves are 
lines of curvature if and only if f = F = 0. 


If f = F = 0 on a coordinate patch, the principal curvatures are given by 
Ki =e / E, кә =g / G. It follows that the Gaussian and mean curvatures have 
the forms 


eg 1 ( e g ) 
К=—— а H--(—+ 2]. 4.20.1 
ЕС” ап 3 (E + G (4.20.16) 
The Gauss equation: Хад = Гоаху + bagn. 


The Weingarten equation: na = —bagg? Ха. 


The Gauss—Mainardi-Codazzi equations: bagbys — Фоубаб = Rôapy: Вов,у = 
bog + Ге sbs, — Г bsg = 0, where Азову denotes the Riemann curvature 
tensor defined in Section 5. 10.3. 


THEOREM 4.20.2 (Gauss's theorema egregium) 


The Gaussian curvature K depends only on the components of the r st fundamental 
metric дав and their derivatives. 


THEOREM 4.20.3 (Fundamental theorem of surface theory) 


If gag and bag are suf ciently differentiable functions of u and v which satisfy the 
Gauss—Mainardi-Codazzi equations, det(gas) > 0, g11 > 0, and go» > 0, then a 
surface exists with I = gag du“ du“ and II = bag du“ du“ as its r st and second 
fundamental forms. This surface is unique up to a congruence. 
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4.20.2.3 Example: paraboloid of revolution 


A Monge patch for a paraboloid of revolution is given by x = f(u,v) = (u,v, u 


2 


+ 


02), for all (u,v) € U = Ж. By successive differentiation one obtains x, = 
(1,0, 2u), x, = (0,1, 2v), xy, = (0,0, 2), Xuv = (0,0,0), and x,, = (0,0, 2). 


1. 
2: 


10. 


11. 


12. 


Unit normal vector: n = (1 + 4и? + 4v?)7ž (-2u, —2v, 1). 


First fundamental coef cients: E(u,v) = gii(u,v) = 1 + 402, F(u,v) 
gi2(u, v) = 4uv, G(u,v) = gas(u, v) = 1 + 447. 


. First fundamental form: I = (1+4u?) du? +8uv du 40--(1--402) 402. Since 


F(u,v) = 0 > u = 0 or v = 0, it follows that the u-parameter curve v = 0 
is orthogonal to any v-parameter curve, and the v-parameter curve u = 0 is 
orthogonal to any u-parameter curve. Otherwise the u- and v-parameter curves 
are not orthogonal. 


. Second fundamental coef cients: e(u,v) = b11 (u,v) = 2(1 + 4u? + 402), 


1 


f (u,v) = bis(u, v) = 0, g(u,v) = bos (u, v) = 2(1 + 4и? + 402) 2. 


. Second fundamental form: IT = 2(1 + Au? + 4v2)~2 (du? + dv?). 


. Classi cation of points: e(u,v)g(u, v) = 4(1+4u?+4v?) > 0 implies that all 


points on S are elliptic points. The point (0, 0, 0) is the only umbilical point. 


. Equation for the principal directions: uv du? + (v? — и?) du dv + uv dv? = 0 


factors to read (и du + v dv)(v du — u dv) = 0. 


. Lines of curvature: Integrate the differential equations, u du + v dv = 0, and 


v du —v du = 0, to obtain, respectively, the equations of the lines of curvature, 
už +v? = r°, and u/v = cot Ө, where r and 0 are constant. 


. Characteristic equation: (1 + 4и? + 4w?) A? — 4(1 + 2u? + 2v?) (1 + 4u? + 


4v2)- 3 +4(1 + 4u? 4402) = 0. 

Principal curvatures: ку = 2(1 + 4u? + 4v2)~?, ко = 2(1 + 4u? + 4v2)- 9. 
The paraboloid of revolution may also be represented by x = f(r, 0) = (r cos6, 
r sin 0, r?). In this representation the r- and 9-parameter curves are lines of 


curvature. 
Gaussian curvature: K = 4(1 + 4u? + 4v?) 2 . 


Mean curvature: H = 2(1 + 2u? + 2v2)(1 + 4u? + 4v?)7Ž. 
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4.21 ANGLE CONVERSION 


0.01745 33 0.00029 089 0.00000 48481 
0.03490 66 0.00058 178 0.00000 96963 
0.05235 99 0.00087 266 0.00001 45444 
0.06981 32 0.00116 355 0.00001 93925 
0.08726 65 0.00145 444 0.00002 42407 


0.10471 98 0.00174 533 0.00002 90888 
0.12217 30 0.00203 622 0.00003 39370 
0.13962 63 0.00232 711 0.00003 87851 
0.15707 96 0.00261 799 0.00004 36332 
0.17453 29 0.00290 888 0.00004 84814 


57.2958 : 
114.5916 B à 11.4592 
171.8873 : : 17.1887 


229.1831 : . 22.9183 
286.4789 : . 28.6479 
343.7747 : : 34.3775 
401.0705 \ : 40.1070 
458.3662 : : 45.8366 
515.6620 : : 51.5662 
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4.22 KNOTS UP ТО EIGHT CROSSINGS 


Number of knots 
with n crossings 


2 3 7 21 49 165 552 
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Image by Charlie Gunn and David Broman. Copyright The Geometry Center, Uni- 
versity of Minnesota. With permission. 
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5.9.2 Connection to differential eguations 
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5.10 TENSOR ANALYSIS 
5.10.1 Definitions 
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5.10.4 Metric tensor 
5.10.5 Results 
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5.11 ORTHOGONAL COORDINATE SYSTEMS 


5.111 Table of orthogonal coordinate systems 


5.12 CONTROL THEORY 


5.1 DIFFERENTIAL CALCULUS 


5.1.1 LIMITS 


If lim f(a) = A < oo and lim g(a) = В < oo then 
а-ға 2-ға 


1. lim (f(x) +д(@щ)=А+В 


ra 


2. lim /(4)0(2) = АВ 


oe. 4 1 


4. lim | (49 9-8 Gf4>0) 
5. lim A(f(x)) = МА) (if h continuous) 


6. If Қа) € g(x), then A < B 
7. If A= B and f(x) € h(x) < g(x), then lim h(a) =A 
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EXAMPLES 


tN? 1 sin ax 
1 Jm (1+ z) е Би UE 
2. lim ai Био 
2 оо р 2 Hin т loge 
. log x : 
шеу — log (1 
3. lim = = 0 (ifg > 0) 7 lim 98025 | 
2-0 т 


4. lim 2? Пов т] — 0 Gf p > 0) 


5.1.2 DERIVATIVES 


The derivative of the function f(a), written / (ж), is de ned as 


A130 Ar Ci) 


if the limit exists. If y = f(x), then gu = f'(x). The n™ derivative is 


NO Ш dy» = d (<4) dy Ш 


Jr dr" —1 


dr | dz 


The second and third derivatives are usually written as y" and y". Sometimes the 
fourth and fth derivatives are written as y(?) and y(?). 

The partial derivative of f(x,y) with respect to x, written /,(т,у) or a is 
de ned as 


; (5.1.2) 


5.1.3 DERIVATIVES OF COMMON FUNCTIONS 


Let a be a constant. 


f) Жа) f) (г) f) 


—csczcotz — csch z coth x 
sec x tan x — sech r tanh x 
—cse? ж 
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5.1.4 DERIVATIVE FORMULAE 


Letu, v, ш be functions of r, and let a, c, and n be constants. Appropriate non-zero 


values, differentiability, and invertability are assumed. 


d d 
(a) — (a) =0 b) = (2) 21 
d du d du | dv 
d du dv dw dv du 
(e) qz; (ur) =v t Y (f) аг (49ш) =w + шш + 0ш 
(8) d (8) _ 14и udv  vw(du/da) — u(dv/da) 
5 dr 0) vds vag v? 
КЕШТІ Ы D L un puri SU v du 
(h) P (u^) = nu Ер 0) i: (u?) = vu d + (log, u)u EE 
. d _ 1 du d _ ldu 
0) az; (Ми) = 2/u de (k) аг 008.5) 242 
4 = 1 du d f1N lidu 
(D Ar (log, u) = (log, e as (m) ae (=) =a WE 
(n) d КОР n du d fu™\ | u du dv 
М dr un) аах (o) ат (ут) эт! \ de 
d NAJMA — ,,n—l,m—1 du dv 
o žito zov (no smal) 
Я mod ove du 
а) X 6) = Žu 59 
d? | df du df ашү? 
(1) di (f(u)) = а) “а а (2) 
(s) = n E. n dvd" ^u |, na 4" 
S dan 7 00) den ^ A1) de dar п) der“ 
d [* d [* 
© Z roam) w É f 1®@=-/@) 
z Je dz J» 


хи 


-1 2 2 3 
уол ad жЕ, ү. 
dy ат ау2 dx? ат 
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F, 
(w) If F(z, y) = 0, then ШШ e and 


da: F, 
Фу Е (КЕ? — QP yy Fy Fy + ЕЕ?) 
di RB 
(x) Leibniz's rule gives the derivative of an integral: 

d g(x) 9(2) Өр, 
E[S Mend) =o a, sle) о 08) ziada. 
dr (қа) а) дт 
(y) If x = x(t) and y = y(t) then (the dots denote differentiation with respect to t): 

dy _ 10) Tu žu ay 
da — à(t) da? — (à) ` 


5.1.5 DERIVATIVE THEOREMS 


1. Fundamental theorem of calculus: | Suppose f is continuous on [а, b]. 


2 


(а) If G is dene d as G(z) = 1 f(t) dt for ай x in [a,b], then С is an 
antiderivative of f on [а,Ь]. 
b 
(b) If F is any antiderivative of f, then f f(t) dt = F(b) — F(a). (Recall 
a 
that fi Ка) dx is de ned as a limit of Riemann sums.) 


2. Intermediate value theorem: If f(x) is continuous on [a,b] and if f(a) Z 
f(b), then f takes on every value between f(a) and f(b) in the interval (a, 


b) 
3. Rolle’s theorem: If f(x) is continuous on [a, b] and differentiable on (a, b) 
and if f(a) = f(b), then f'(c) = 0 for at least one number c in (a, b). 


? 


4. Mean value theorem: If f(x) is continuous on [a,b] and differentiable on 
(a, b), then a number c exists in (a, b) such that f(b) — f(a) = (b — a) f (0). 


5.1.6 THE TWO-DIMENSIONAL CHAIN RULE 
If x = x(t), у = y(t), and z = z(x,y), then 
dz _ Oz de 0zdy 
dt Oxdt Ody dt’ 
Pi zr , de (Sede Өз) 
d? Ord? dt \ Ox? dt Əxðy dt 
Oy d? | dt \ Oy? dt = Oxdy dt) 


and 


(5.1.3) 


© 2003 by CRC Press LLC 


If x = z(u,v), y = y(u,v), and z = z(x,y), then 
dz ддв дб mg Oz _ Bz On , Oz dy 
ðu  OÓrOÓu дуди ðv Ox dv Oy dv 
If u = u(z,y), v = v(z,y), and f = f(x,y), then the partial derivative of f 


with respect to u, holding v constant, written (22); ‚ сап be expressed as 


2) -(2) (2) «BB. өө 


5.1.7 LHOSPITAL’S RULE 


If f(x) and g(x) are differentiable in the neighborhood of point a, and if f(x) and 
g(x) both tend to 0 or oo as 2-9 a, then 


(5.1.4) 


Га) (5.1.6) 


1f the right hand side exists. 


EXAMPLES 
li x — sin x 1 1 — cos x 1 sin x COS X 1 
1111 — = — 
2—0 13 z30 За? 2-50 бх 250 6 6” 
n n—1 n—2 ! 
т 2 n(n — 1)x . mn 
lim — — lim = I ( ) = lim — —0 
roo e? 2-900 ез 200 её r—oo e? 


5.1.8 MAXIMA AND MINIMA ОҒ FUNCTIONS 


1. If a function f(a) has a local extremum at a number c, then either f (c) = 0 
or f (c) does not exist. 


2. If f'(c) = 0, f(x) is differentiable on an open interval containing c, and 


(a) if f" (c) < 0, then f has a local maximum at c; 
(b) if f"(c) > 0, then f has a local minimum at c. 


5.1.8.1 Lagrange multipliers 


To nd the extreme values of the function f/(x1,22,...,24) = f(x) subject to the 
m side constraints g(x) = 0, introduce an m-dimensional vector of Lagrange mul- 
tipliers A and de ne F(x, А) = f(x) + A'g(x). Then the extreme values of F with 
respect to all of its arguments are found by solving: 

OF. д} UI Og — OF 


For the extreme values of f(x, y) subject to g(x, y) = 0 G.e., n = 2 and m = 1): 


fe + Ag = 0, fy + Ady = 0, and 4-0. (5.1.8) 
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EXAMPLE т» nd the points on the unit circle (given by g(x,y) = (x — 1)“ + (y — 
2)? — 1 = 0) that are closest and furthest from the origin (the distance sguared from 
the origin is f(x,y) = 22 + y?) can be determined by solving the three (non-linear) 
algebraic eguations: 


2x +2XM(1 —1)—0, — 2y+2X(y — 2) = 0, (2 —1)“ + (у — 2)“ = 1. 


The solutions are y = 1 + 1/у5, у = 2+ 2/У5А = —1 — V5 (furthest), and 
т = 1— 1/\/5, у 22 — 2/\/5, А = V5 — 1 (closest). 


5.1.9 VECTOR CALCULUS 


1. De nition s of "div", "grad", and "curl" are on page 493. 


2. A vector eld Fis irrotational if V x F = 0. A vector eld Fis solenoidal if 
V.E —0. 


3. In Cartesian coordinates, V — (2. Ti 2) = = 2. 5515) + Ка 9 . If u and v 


are scalars and F and G are vectors in R3, then 


V(u +v) = Vu + Vv, 
V(uv) = uVv +vVu, 


V(F +С) = VF + VG, 
be б) = (F: V)G-(G- VE+FEx (Vx G) - Gx (VxF), 
V- (uF) = VF) +Е. Vu, 
5. хб)-С.(УхЕ)-Е.(У x С), 
x (uF) = «(У x F) + (Vu) x F 
шоо VxF+VxG 
V x (Fx G) = F(V.G) - G(V. F) + (G- V)F — (F. V)G, 
is dE тр s 
dt 
2. F) – VF, 
x (Vu) — 0, 
ven 0, and 
V?(uv) = uV?v + 2(Vu) - (Vv) + v V? 


Note that V -u = 4 эь is a scalar while F- V = Da 15) 
орега(ог. 


E- is an 


4. If r = |r|, a is a constant vector, and n is an integer, then 
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n(n + 1)" а | nr"7?a + n(n — 2)r"-*(r -a)r 
n(n + 3)r^^?r n(n 4-3)" ?r 
[га — 2(r - a)r]/r* 


d dF dG 

—(F =й pst 

ai ш. ТИШТЕ 

а dG ЧЕ 
—(F. = De 

ai e dt^ dt 6; 
а dG dF 
(Е С) кх TEM 


d dV dV 
a х Vo x V3) = ЕЗ x (Vo x V3) +V, х (e3 хуз), 


АЛАЙ - (2) АД + М (22) 2 + М2 ЕЗІ 


where [V1 V2V3] = Vi - (У x Уз) is the scalar triple product (see page 136). 


5.1.10 MATRIX AND VECTOR DERIVATIVES 
5.1.10.1 De nitions 


1. The derivative of the row vector y = [vi ya ee Ym] with respect to the 
scalar x is 9 
Cy 1Тдл Oy» дум (5.1.9) 
Ox дт Ox Ox 


2. The derivative of a scalar y with respect to the vector x is 


By 
Әлі 


Ф 
Ф, 
alg 


Oy _ 


x = (5.1.10) 
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. Let x be an x 1 vector and let y be a m x 1 vector. The derivative of y with 
respect to x is the matrix 


2yi ду? дут 

Әлі Әлі сга Әлі 
a 2yi ду? дут 

5 5 pin tm 
EM E] Ede. Pt Z (5.1.11) 
дх ж . . . 

2yi ду? дут 

дел дел ics Od 


In multivariate analysis, if x and y have the same dimension, then the absolute 


value of the determinant of oy is called the Jacobian of the transformation 


determined by y = y(x), written BUY IY 25 nn) 


O(21,22,...4n) 


. The Jacobian of the derivatives 29 ше ; $e. ; m of the function ф(ғ1,... £n) 
with respect to z1,...,z4 is called the Hessian Н of ©: 

876 92ф 92ф 92ф 

да? дал 0x2 дал даз 021 Әл, 
876 92ф 92ф 92ф 

H= дао дол да? дао даз 022 Ойл, 
92ф 92ф 92ф 9? ф 
да, Әлі да, Әло Әл, Әлз дал 


. The derivative of the matrix A(t) = (a;;(¢)), with respect to the scalar t, is the 


matrix 24) = (444). 


. If X = (zij) sam x n matrix and if y is a scalar function of X, then the 
derivative of y with respect to X is (here, Fij = еге): 


ду ду ду 
Әлі 0212 Әліп 
ду 5 y ЖИП ap wig y ду 
z z don 
ut eu pat 2 “іш V Ey. (5.1.12) 
Ox : Е E : дт 
5 . * . 1<i<m 
Oy Oy Oy 1<j<n 
OZmi 00m2 ``? lmn 


7. ШҮ = (yij) isa p X g matrix and X is am х n matrix, then the derivative of 


Y with respect to X is 


oY oY oY 

д д д 

дт ау ay” 
OY 0221 0x22 IE БЕР OY 
сы = M By ®——. (5113 
OX : : 2 : Ox 5; 

d d . Қ 1<i<m J 
ay ay ay 1</<п 
Әтті Әтто Imn E 
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5.1.10.2 Properties 


y (a scalar or a vector) oy (recall, x is a vector) 


(with A constant) 


DC sá 
YZ Ye + RZ 
AXB АТВ? 
a" XTXb X(ab" + Һа”) 
alXTXa 2Xaa! 
a" XTOXb C" Xab! + CXba" 
аї ХТС Ха (C + CT) Хаат 
3. (Xa 4- b)C(Xa +b) (C + CT)(Xa +Ъ)аТ 
tr( X) I 
tr( AT X), tr(X AD), tr(AXT), or tr (XT A) А 
tr(X AXT) XT(A + AT) 
tr(XTAX) (A + АТ) X 
tr(XT AX B) АХВ- ATXBT 
det(X) or det( XT) det(X)(X-1)T 
log [X | Cae 
(with fa, b, A, В} constants, Y = Y(X), and Z = Z(X)) 
y (a scalar, vector, or matrix) LÀ (here £ is a scalar) 
4. «В + AS 


dA dB 
5- 9B+A4oB i 
— A JA 4-1 


(with A = A(t) and В = B(t)) 
5. КУ = AX-! B, then 
(а) 21---АХ-1Б,Х-18В. 


(b) 8% = -(X-)T ATE;B'(X-1)T. 


© 2003 by CRC Press LLC 


= АЕ,; В where Ej; = ee} has the same size as X. 


душ _ 
7. ШУ = АХТВ, then e = ВЕТА. 
8. If Y = ХТАХ, then 


(а) У = = ЕТ АХ + ХТАЕ,, 


(b) Zä = AX ET, + ATX Ei. 


9. If y = Мес У and x = Vec X (see page 158), then 
(а) FY = AX, then & = I AT. 

(b) ЖУ = XA, then 2 = AG I. 

(с) fY = AX-1B, then & = -(X-1B) 8 (X-!)T AT. 


10. The derivative of the determinant of a matrix can be written: 


9 Ү ду; 
Berg = Dt Loy Vis Ba 
(b) If all the components (x;;) of X are independent, ilic ape = |X| (X71). 


(a) If Y; is the cofactor of element y;; in 


11. Derivatives of powers of matrices are obtained as follows: 
(а) If Y = X", then 2— = Ул, Xt Ep X n-5-1. 
(b) ЖҮ = Х-", then ŽL = —x-" (XL X e xe X. 


c) The т derivative of the r power of the matrix A^! , in terms of deriva- 
р 
tives of the matrix А, is 


d^ Ат" n ФР, P; P; 
=_= п -1/-5--23-2..--5 | АТ" 5.1.14 
ал 7" (> emer | саг 
where P; = АТ" p a and the summation is taken over all positive in- 
tegers (41,42,...,% à). distinct or otherwise, such that EROR im = m. 
Setting n = r = 1 results in 
алт! ал 
= -AIL A, 5.1.15 
dx dx ( ) 
12. Derivative formulae: 
д»  OzOx 
1f z = then — = — —. 
(a) If z = z(y(x)), then op Эх ду 
(b) If X and Y are matrices, then [nr = ae 


(c) If X, Y, and Z are matrices of size m x n, n x v, and p x g, then 
O(XY 
QUY) — 8X (1, @Y) + (Ip ө Х)ӘҰ. 
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5.2 DIFFERENTIAL FORMS 


De пе ат,(-) to be the function that assigns a vector its k“ coordinate; that is, for 
the vector a = (а1,...,ар,...,аһ), we have dx, (a) = ак. Geometrically, dz; (a) 
is the length, with appropriate sign, of the projection of a on the k“ coordinate 
axis. When the {F;} are functions, the following linear combination of the functions 
{dag} 

wy = Fy (x) ағ + Р(х) dry +--+ + Е. (х) ағ, (5.2.1) 


produces a new function wy. This function acts on vectors a as 
шх(а) = F(x) dai (a) + Р(х) dza (a) +--+ + Е„(х) ат, (а). (5.2.2) 
Such a function is a differential 1-form or a 1-form. For example: 
1. Ifa = (—2,0, 4) then dz, (a) = —2, іг (а) = 0, and dzz (a) = 4. 


2. If in R^, wx = шү») = 2? dz + y? dy, then ws yy (a,b) = аа? + by? and 
W(1,—3) (a, b) = а + 9b. 


3. If f(x) is a differentiable function, then V , f, the differential of f at x, is a 
1-form. Note that V, f acting on a = (a1, a2, a3) is 


Vxf(a) = 35, (Ж) dai (a) + Lw dx2(a) + Liw ата (a) 


5.2.1 PRODUCTS OF 1-FORMS 


The basic 1-forms in R are dz, dz», and ата. The wedge product (or exterior 
product) dx, ^ dx» is de ned so that it is a function of ordered pairs of vectors in 
R“. Geometrically, dx ^ dz» (a,b) will be the area of the parallelogram spanned by 
the projections of a and b into the (2:1, x2)-plane. The sign of the area is determined 
so that if the projections of a and b have the same orientation as the positive x and 
тә axes, then the area is positive; it is negative when these orientations are opposite. 
Thus, if a — (a1 ,02, аз) and b = (bi, ba, bs), then 


dai ^ ат» (а, b) — det | | = a1 b> — аә, (5.2.3) 
2 02 
and the determinant automatically gives the correct sign. This generalizes to 
| | 2 dri(a) deilb)| | ai bi 
dx; ^ dz j(a, b) = det 22 dej(b)| ^ det Z (5.2.4) 


1. Ifw and и are 1-forms, and f and g are real-valued functions, then fw + gy is 
a 1-form. 
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2. If u, v, and и are 1-forms, then (fw + gv) NU — fv Au + gvN р. 
3. dx; A ат; = —dz; A dx; 

4. dx; A dx; -0 

5. dx; A ат; (b, a) — —@ A ах; (а, b) 


5.2.2 DIFFERENTIAL 2-FORMS 


In В, the most general linear combination of the functions 42, A ат; has the form 
сі ахо A ахз + ca ала ^ dai + cz day A ахо. If F = (Е, F5, Ез) is a vector eld, 
then the function of ordered pairs, 


т (а, b) =F, (x) алә ^ dz3 + Р (x) ала ^ dx, + Ез (x) dx, ^ dz», (5.2.5) 


is a differential 2-form or 2-form. 
EXAMPLES 
1. For the speci c 2-form Tx = 2 dz» ^ ахз + ата ^ dai --5аті ^ dao, if a = (1, 2,3) 
and b — (0, 1, 1), then 


2 1 3 1 1 0 
T(a, b) = 2 det É || + de | o| өзде E | 


=2.(—1)+1-(—1)+5-(1)=2 


(2,1,5): (a x b). 
2. When changing from Cartesian coordinates to polar coordinates, the element of area 
dA can be written 
dA = dx ^ dy 
= (—r sin 046 + cos 0 dr) ^ (r cos 6 40 + sin Ө dr) 
= —r’ sin 6 cos 0 (40 Л 10) + sin 0 cos 6 (dr ^ dr) (5.2.6) 
— rsin? 0 (40 ^ dr) + r cos? 0 (dr A dé) 
= гаг ^ аб. 


5.2.3 THE 2-FORMS IN R” 


Every 2-form can be written as a linear combination of “basic 2-forms”. For exam- 
ple, іп R? there is only one basic 2-form (which may be taken to be dx; ^ dz») and 
in IR? there are 3 basic 2-forms (possibly the set [dai ^ dao, алә ^ хз, drz Л аху +). 
The exterior product of any two 1-forms (in, say, R”) is found by multiplying the 1- 
forms as if there were ordinary polynomials in the variables dr ,..., d£n, and then 
simplifying using the rules for dx; A dr. 
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EXAMPLE Denoting the basic 1-forms in IR? as dx, dy, and dz then 


(ada + y? dy) ^ (dx + x dy) = x (dx ^ dx) + y^ (dy ^ dz), 
+ x? (dx ^ dy) + zy? (dy ^ dy), 
= 0 — y? (da ^ dy) + x^ (dx ^ dy) +0, 
= (x? — y?) dx ^ dy. 


(5.2.7) 


5.2.4 HIGHER DIMENSIONAL FORMS 


The meaning of the basic 3-form 421 ^ dx» ^ dz is that of a signed volume function. 
Thus, if a = (a1,a2, аз), b = (bi, ba, bs), and c = (c1, сх, сз) then 


at bi C1 
dai ^ ат» A ахз (а,Ь, с) = её аә b» C2 (5.2.8) 
аз b3 сз 


which is a 3-dimensional oriented volume of the parallelepiped de ned by the vectors 
a, b, and c. 


For an ordered p-tuple of vectors in R”, (aj, a», ..., ap), where p > 1 
dry, ^ dag, A+++ A аты, (а1,... ‚аь) = det(drp, (aj))i-1,....p- (5.2.9) 
7-41,..4р 


This equation de nes the basic p-forms in IR", of which the general p-forms аге 
linear combinations. Properties include: 


1. The interchange of adjacent factors in a basic p-form changes the sign of the 
form. If w? is a p-form in IR" and wf is a g-form in IR", then 
wP A wt = (—1)P1 11 A Р. 


2. A basic p-form with a repeated factor is zero. 
3. If p > n, then any p-form is identically zero. 


4. The general p-form can be written ш? = Э УТУ fu, dz Л Лат, 


where 1 < i, < n for k = 1,...,p. This sum has (p) distinct non-zero terms. 


5.2.5 THE EXTERIOR DERIVATIVE 


The exterior differentiation operator is denoted by d. When d is applied to a scalar 
function f(x), the result is the 1-form that is equivalent to the usual “total differen- 
tial” df = Vxf = ы. ал +: AL dz. For the 1-form w! = fi d+ -+ fn dEn 
the exterior derivative is du! = (dfi) ^ dzi +--+ + (dfn) ^ dan. This generalizes 
to higher dimensional forms. 


EXAMPLES 
1. If f (zi, 22) = тү + x3, then df = d(x? + z3) = 2x1 dzi + 322 dza. 
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2. Шалы» = тхо ахі + (z? + 23) dz», then du! is given by 


dw! = d(ziza dai + (x? + x3) dz) 
= (тэ dai + x1 ат») Аах\ + (221 dx; + 2x2 ат») Лат» 


= Т1 dai ^ dax». 


5.2.6 PROPERTIES OF THE EXTERIOR DERIVATIVE 


1. If fi(z1, £2) and fo(x1, 22) are differentiable functions, then 


dfi ^ аў = det (525) dx, A ат». 
д(21, £2) 


2. If w? and wt represent а р-Ғог and a g-form, then 
d(wP Awt) = (dw?) ^w + (—1)?twP A (dut). 
3. If w? is a p-form with at least two derivatives, then d(dw?) = 0. 
(a) The relation d(dw°) = 0 is equivalent to 
curl(grad f) = V x (Vf) —0. (5.2.10) 
(b) The relation d(dw') = 0 is equivalent to 
div(curlF) = V - (VF) = 0. (5.2.11) 


5.3 INTEGRATION 


5.3.1 DEFINITIONS 
The following de nitions apply to the expression I = [ x J (x) ал: 


1. The integrand is f(x). 

2. The upper limit is b. 

3. The lower limit is a. 

4. I is the integral of f (x) from a to b. 


It is conventional to indicate the inde nite integral of a function represented 
by a lowercase letter by the corresponding uppercase letter. For example, F(x) = 
f° f(t) dt and G(x) = f” g(t) dt. Note that all functions that differ from F (x) by a 

а а 
constant are also inde nite integrals of f(x). We will use the following notation: 
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1. | f(x) da 


6. Improper integral 


inde nite integral of f(x) (also written f” f(t) dt) 


de nite integral of f(x), de ned as (for a continuous 
function) 


li ку m ) 
Hy Re цаг ны 
de nite integral of f(x), taken along the contour С 
R 
de ned as lim | f(a) dx 
Hoo Ja 


de ned as the limit of f . Ка) dx as В and S inde- 
pendently go to со 


integral for which the region of integration is not 
bounded, or the integrand is not bounded 


7. Cauchy principal value 


(a) The Cauchy principal value of p f(x) ах, denoted р f(x) dz, is de- 


ned as lim 
60+ 


gular only at c. 


(b) The Cauchy principal value of the integral [ x f(x 


C—€ 


b 
f(x) dz + f(x) 7 , assuming that f is sin- 
a с+є 


) da: is de ned as ће 


R 
limit of | f(a) dz as R > oo. 
-R 


8. If, at the complex point z = a, f(z) is either analytic or has an isolated sin- 
ans Шыг the 25 of f(z) at z = a is given by the contour integral 


Resg(a = oon fe HA 
МСА 


£) d£, where C is a closed contour around a in a positive 


5.3.2 PROPERTIES OF INTEGRALS 


Inde п ite integrals have the properties (here F is the antiderivative of f): 


1. Цэр + 2 dx = ды, f(a) dz + | dr (linearity). 


2. | f(x)g(x) dx = - f F(x (integration by parts). 
3. f f(g(x))g'(x) dz = F(g(z)) (substitution). 
4. . ж = &Е(ах + b). 


5. If f(x) is an odd function and F(0) = 0, then F(x) is an even function. 
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6. If f(x) is an even function and F (0) = 0, then F(x) is an odd function. 


7. If f(x) has a nite number of discontinuities, then the integral f f(x) ат is 
the sum of the integrals over those subintervals where f(x) is continuous (pro- 
vided they exist). 


8. Fundamental theorem of calculus If f (x) is bounded, and integrable on [a,b], 
and there exists a function F(x) such that F'(z) = f(x) fora < x < b then 


| "fle) dz = Fa) |" = Fle) — F(a) (5.3.1) 
fora < 2 < b. 


De nite хийн have the properties: 


1. [A - dx = 0. 
2; P Үгэн = e х) dz. 
ЗОГЖ A ) da + ЈУ = = ft f(z) (additivity). 


4. Prefa ) + dg(x ur = cf! f(a) dx + um dx (linearity). 


5.3.3 METHODS OF EVALUATING INTEGRALS 
5.3.3.1 Substitution 


Substitution can be used to change integrals to simpler forms. When Л trans- 


2 - DU ) is chosen, the integral J = f f(t) dt becomes I = f f(g(x)) dt = 
/ f(g x) dx. Several precautions must be taken when using 1. 


1. Be sure to make the substitution in (һе dx term, as well as everywhere else іп 
the integral. 


2. Be sure that the function substituted is one-to-one and differentiable. If this is 
not the case, then the integral must be restricted in such a way as to make it 
true. 


3. With de nite integrals, the limits should also be expressed in terms of the new 
dependent variables. With inde n ite integrals, it is necessary to perform the 
reverse substitution to obtain the answer in terms of the original independent 
variable. This may also be done for de nite integrals, but it is usually easier to 
change the limits. 


EXAMPLE Consider the integral 


4 
x 


for a # 0. Неге we choose to make the substitution x = |a| sin 9. From this we nd 
dz = |а| cos 0 40 and 


Va? — r? = Va? — a? sin? 6 = |а| V1 — sin“ 0 = |а| |cos 6| . (5.3.3) 
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Note the absolute value signs. It is very important to interpret the sguare root radical 
consistently as the positive sguare root. Thus va? = |x|. Failure to observe this is a 
common cause of errors. 

Note that the substitution used above is not a one-to-one function, that is, it does 
not have a unique inverse. Thus the range of 0 must be restricted in such a way as to 
make the function one-to-one. In this case we can solve for 6 to obtain 


9 — sin“! lar (5.3.4) 
This will be unique if we restrict the inverse sine to the principal values -$ < 0 < 5. 
Thus, the integral becomes (with dr = |a| cos 6 40) 
4 un 

0 
T= | SE ja) cos 8 do. (5.3.5) 

|а| |cos 6| 
Now, however, in the range of values chosen for 9, we nd that сов 0 is always non- 
negative. Thus, we may remove the absolute value signs from cos 0 in the denominator. 

Then the cos 0 terms cancel and the integral becomes 


1 — a“ / sin“ 9 dé. (5.3.6) 


By application of integration formula #283 on page 430, and simpli cations, this is 
integrated to obtain 


4 4 4 
1--% sin“ 9 cos 9 — K sin 6 cos 8 + 5-6 + С. (5.37) 


To obtain an evaluation of J as a function of x, we must transform variables from 9 
to т. We have 


2 2 2, 
cos6 = V1 — sin? = 44/1- 55 MM (5.3.8) 


Because of the previously recorded fact that cos 9 is non-negative for our range of 6, 
we may omit the + sign. Using sin = z/|a| and cos = Va? — z?/ |а| we can 
evaluate Equation (5.3.7) to obtain the nal result, 


3 2 4 
-Zve — x? — Ve = 2? + Зат Z 4+0. (539) 


lal 


i-[—— = 
72-02 


5.3.3.2 Partial fraction decomposition 


Every integral of the form f R(x) dx, where R is a rational function, can be evalu- 
ated (in principle) in terms of elementary functions. The technique is to factor the 
denominator of Б. and create a partial fraction decomposition. Then each resulting 
sub-integral is elementary. 


2x7 — 10x“ + 13x — 4 Р 
os dz. This can be written as 
x£? — 5x 


x —4 2 1 
1= [ (+2) da= | (25 5 - 4) dx 


which can be readily integrated I = x” + 21n(a — 2) — In (x — 3). 


EXAMPLE Consider I = / 
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5.3.3.3 Useful transformations 


The following transformations may make evaluation of an integral easier: 


1. f f (v, a? + a?) dz = a f f(atanu, авес и) sec? u du 


when и = tan“! £ and a > 0. 


2. | f (а, Va? — а?) de = a f flasecu,atan u) secu tanu du 

when u = sec“! 2 and a > 0. 
3. | f (zx, Va? — a?) da = a f f(asinu,acosu) cosu du 

when и = sin“! 2 anda > 0. 
4. f f(sinz) dz 22[f (128) т when z = {ап 2. 
5. f f(cosz) dr = 2 f f (==) т when z = tan £. 
6. | f(cosz) dx = MET when v = cos 2. 
7. f f(sinz) dz = f f(u) i VET when u — sin z. 
8. | f(sinz,cosz) dr = f f (u, V1— и?) т when u = sin x. 
9. | fleinz,cosn) de =2 f f (2) тт when z = tan Z. 


n 
di 
10. |29 f(u)dr = |9 f(x) dx when u = x — J — where {a;} is an 
155, Flu) do = | 18) хоосон 
sequence of positive constants and the fc, } are any real constants whatsoever. 


Several transformations of the integral | С^ f(x) dx, with an in nite integration 
range, to an integral with a nite integration range, are shown: 


fo IC 081 dt 


hi ДЕ z) ттт 


1g (3 log 14) т“ 


5.3.3.4 Integration by parts 


In one dimension, the integration by parts formula is 
E dv — uv — E du for inde n ite integrals, (5.3.10) 


b b 
1 udv = uv ji — / vdu for de nite integrals. (5.3.11) 
a a 


When evaluating a given integral by this method, u and v must be chosen so that the 
form [ u dv becomes identical to the given integral. This is usually accomplished by 
specifying и and dv and deriving du and v. Then the integration by parts formula 
will produce a boundary term and another integral to be evaluated. If u and v were 
well-chosen, then this second integral may be easier to evaluate. 
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EXAMPLE Consider the integral 


T= | «наг, 


Two obvious choices for the integration by parts formula are (и = x, dv = sin x dx} 
and {u = sin x, du = x dx}. We try each of them in turn. 


1. Using {u = т, dv = sin x dz), we compute du = dx and v = f dv = f sin © dx = 
— cos x. Hence, we can represent J in the alternative form as 


1- | агаг = f udu m | vdu > —ecosa + | cose de. 


In this representation of J, we must evaluate the last integral. Because we know 
| соза dr = sin x the nal result is I = sin x — z cos x. 


2. Using fu = sin x, dv = x dx} we compute du = cos r dz and = f dv = [хат 
x? /2. Hence, we can represent J in the alternative form as 


2 2 
1- | тта = | udv=w- | өйи = Žrsina | S cosade. 


In this case, we have actually made the problem “worse” since the remaining integral 
appearing іп 1 is “harder” than the one we started with. 


EXAMPLE Consider the integral 


1- | esingda. 


We choose to use the integration by parts formula with и = e^ and dv = sina dz. 
From these we compute du = e” dx and v = f dv = | sin x dr = — cos x. Hence, 
we can represent J in the alternative form as 


1- | etsinede = | аа ао | vdu = е cose + | е^ cosede, 


If we write this as 
I = —e" cos x + J with J= fe cos z da, (5.3.12) 


then we can apply integration by parts to J using {u = е, dv = cos т ах}. From 
these we compute du = е" dr and v = f dv = | cosz dz = sin r. Hence, we can 
represent J in the alternative form as 


танг 


If we write this as 
J = e? sin x — I, (5.3.13) 


then we can solve the linear eguations (5.3.12) and (5.3.13) simultaneously to deter- 
mine both [ and J. We nd 


1- [sine de = 


J= | ёсовиав = 


(e" sin x — e” cosx), and 
(5.3.14) 
(е? sin z + e” cos x). 


кю|ҥ Mile 
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5.3.3.5 Extended integration by parts rule 


The following rule is obtained by n + 1 successive applications of integration by 
parts. Let 


(5.3.15) 


| («o da = f(a)gi (x) — }'(®)до(ж) + f" (1)gs(x) —... 


+ CD^f да айв) + (DP f fo agaa) dz. (5.3.16) 


5.3.4 TYPES OF INTEGRALS 


5.3.4.1 Line and surface integrals 
A line integral is a de nite integral whose path of integration is along a speci ed 
curve; it can be evaluated by reducing it to ordinary integrals. If f(x, y) is continuous 
on C, and the integration contour С is parameterized by (ф(#), b(t)) as t varies from 
a to b, then 
b 
[ feas f (900) iOa, 
E E (5.3.17) 
[леда = | (0.00) а. 
а 
In a simply-connected domain, the line integral I = f. c X dz +Y dy + Z dz is 
independent of the closed curve C if, and only if, u = (X,Y, Z) is a gradient vector, 
u = grad F (that is, Р; = X, Fy = Y, and F, = Z). 
Green’s theorem: Let Р be a domain of the ry plane, and let C be a piecewise- 
smooth, simple closed curve in D whose interior R is also in D. Let P(x,y) and 
Q (2, y) be functions de ned in D with continuous rst partial derivatives in D. Then 


2, д0 ӘР 
фа +0 dy) = ! (2 - 2) dx dy. (5.3.18) 


The above theorem may be written in the two alternative forms (using u = 
P(z,y)i+ Q(z, y)j and v = Q(z, y)i — P(z,y)j), 


іш ds = || «вашавад апа 4» ds — /] div v dz dy. (5.3.19) 
C C 
R R 


The rst equation above is a simpli cation of Stokes's theorem; the second equation 
is the divergence theorem. 
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Stokes’s theorem: Let S be a piecewise-smooth oriented surface in space, whose 
boundary C is a piecewise-smooth simple closed curve, directed in accordance with 
the given orientation of S. Letu = Li + Mj + Nk be a vector eld with con- 
tinuous and differentiable components in a domain D of space including S. Then, 
Jour ds = | (curl u) : ndo, where n is the chosen unit normal vector on S, that is 

S 


СЕНЕ | (550) dy dz 


OL ON OM OL 
+ (22 2 =) явах (= A mi de dy. (5320) 


Divergence theorem: Let v = Li + Mj + Nk be a vector eld in a domain D 
of space. Let L, M, and N be continuous with continuous derivatives in D. Let S 
be a piecewise-smooth surface in D that forms the complete boundary of a bounded 
closed region R in D. Let n be the outer normal of S with respect to R. Then 


е = ff div v dx dy dz, that is 
S R 


f| заа + M dz da маға) 


FU (252) эн 23 атау dz. (5.3.21) 


If D is a three-dimensional domain with boundary В, let dV represent the vol- 
ume element of D, let dS represent the surface element of В, and let dS = n dS, 
where n is the outer normal vector of the surface B. Then Gauss's formulae are 


ТГ -AdV = ея ene 
(хээ (вээ ІШ )45, and (5.3.22) 
Iffvow = Јов 


where ¢ is an arbitrary scalar and A is an arbitrary vector. 

Green’s theorems also relate a volume integral to a surface integral: Let V be 
a volume with surface S, which we assume is simple and closed. De ne n as the 
outward normal to S. Let ¢ and w be scalar functions which, together with V 2ф and 
V2, аге de ned in V and on S. Then 


1. Green’s rst theorem states that 


S) sa 2 | 
| oa, 48 = [ (ФУ20 + Уф: Vi) dV. (5.3.23) 
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2. Green’s second theorem states that 


Op 199 B 
| G = 23 dS = |. (фу? — 9У79) dV. (5.3.24) 


5.3.4.2 Contour integrals 


If f(z) is analytic in the region inside of the simple closed curve C (with proper 
orientation), then 


1. The Cauchy-Goursat integral theorem is $ f(E) dé = 0. 


2. Cauchy's integral formula is 


__1 MG T l J(&) 


(5.3.25) 


^ 2mi 


(np PL AACS) 
In general, f““ (z) $ Е) dé. 


The residue theorem: For every simple closed contour С enclosing at most a nite 
number of (necessarily isolated) singularities {z1, z2,...,2n} of a (single-valued) 
analytic function f(z) continuous on C, 


1 
271 


фов = Y кеу). (5.326) 
k—1 


5.3.5 INTEGRAL INEQUALITIES 


1. Schwartz inequality: f? |/9| € (Ch If?) Ch 0). 


2. Minkowski s inequality: 


(JELE + oP)” < (SPY + а ыр)” when p> 1. 


3. Hólder's inequality: 


b b 1/P [ b 1/g 
Ja (rol ТАР [lop] when +} = р> Lando 


AR 


ІК Ға) а) < йн |f(x)| ах < (лақ irt) (b — a) assuming a « b. 


5. If Қа) € g(x) on the interval [а, 5], then J? f(a) da < ГР g(a) dx. 


© 2003 by CRC Press LLC 


5.3.6 CONVERGENCE TESTS 


1. If p |f (x)| dz is convergent, and f is integrable, then I. f(x) dr is conver- 
gent. 


2. If 0 < f(x) ), Р? g(x) dx is convergent, and f is integrable, then 


Ї J (x) ах is 2. 
3. If 0 € g(x) € f(x) and Ї g(x) dz is divergent, then Ї f (x) dz is divergent. 
The following integrals may be used, for example, with the above tests: 


© dx 99 da 
(a) [i — —— —-— and | — are convergent when p > 1, and divergent when 
4 «(log x)P 1 2? 


1 
d. 
(b) | — is convergent when р < 1, and divergent when р > 1. 
о 7 


5.3.7 VARIATIONAL PRINCIPLES 


If J depends on a function g(x) and its derivatives through an integral of the form 
= [F(g,Vg,...) ат, then J will be stationary to small perturbations of g if 
F satis es the corresponding Euler-Lagrange equation. 


Euler-Lagrange equation 


DENN 
2 


n d^ 
dx” 


SRE (тулы у %)) da: 


[f |a (2) + b (8) + cu?  2fu| dz dy 
R 


Р Ux, Uy, Uze, Uzy, Uyy) dx dy 
R 


5.3.8 CONTINUITY OF INTEGRAL ANTIDERIVATIVES 
Consider the following different antiderivatives of an integral 


2 tan“! (3 tan 2) 


1) = | feas | t= 2 tan“!(3 sin ж/(соз ж + 1)) 


- 4cosz Hu 3sinz/(5cosz — 4)) 
2tan ! (3tan £) + 2s [+3] 
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where |.| denotes the oor function. These antiderivatives are all “correct” because 
differentiating any of them results in the original integrand (except at isolated points). 
However, if we desire ies f(a) dx = F (4m) — F(0) to hold, then only the last 
antiderivative is correct. This is true because the other antiderivatives of F(x) are 
discontinuous when 2 is a multiple of rr. 

In general, if F(x) = [^ f(t) dt is a discontinuous evaluation (with F(a) dis- 
continuous at the single point ж = b), then a continuous evaluation on a nite interval 
is given by f* f(x) dr = F(c) — F(a), where 


F(x) = F(x) — F(a) + H(a — b) | lim F(a) — lim FG) (5.3.27) 


2—b— 2—b+ 
and where H (-) is the Heaviside function. For functions with an in nite number of 


oo 
5 usd a, x — 
discontinuities, note that > H(z — pn — g) = E . 


n=1 


5.3.9 ASYMPTOTIC INTEGRAL EVALUATION 
1. Laplace’s method: If f (x0) = 0, f” (xo) < 0, and A — oo, then 


ш MF (a) Af (во) 2т 
I. (A) = g(x)e dx ~ g(xo)e +.... 


Buck A |f" ао) 

(5.3.28) 

Hence, if points of local maximum {;} satisfy f'(z;) = 0 and f"(z;) < 0, 
then f^^. g(z)eM 9) dz SV, I, (A). 


2. Method of stationary phase: If f (zo) 4 0, f'(zo) = 0, f"(xo) Z 0, g(xo) Z 
0, and A — oo, then 


“Lote : 
Jeo (A) = | g(a)eF €) dx 


20-06 


5 | 
аа ХП ЕЛ? элс) + Ž sen f) +.... (5.329) 


5.3.10 SPECIAL FUNCTIONS DEFINED BY INTEGRALS 


Not all integrals of elementary functions (sines, cosines, rational functions, and 
others) can be evaluated in terms of elementary functions. For example, the in- 
tegral [ e71“ dr is represented by the special function “ег 2)” (see page 545). 
Other useful functions include dilogarithms (see page 551) and elliptic integrals (see 
page 568). 

The dilogarithm function is de ned by Li2(x) = — f; In(1 — t)/tdt. All inte- 
grals of the form f^ P(x, VR) log Q(a, VR) dz, where P and Q are rational func- 
tions and R = A+ Вг + Cz?, can be evaluated in terms of elementary functions 
and dilogarithms. 
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All integrals of the form f, R(x, (/Т(т)) dr, where R is a rational function of 
its arguments and Т(т) is a third- or fourth-order polynomial, can be integrated in 
terms of elementary functions and elliptic functions. 


5.3.11 APPLICATIONS OF INTEGRATION 


1. Using Green’s theorems, the area bounded by the simple, closed, positively- 
oriented contour C is 


area = ody = — { y dx. (5.3.30) 
с с 


2. Arc length: 


(a) s— | V1+y ах for y = f(a). 
(b) 23 Ve + 02 dt for x = ф( = 


02 
(с) s= | °+( ж. 1+ ж СЕТ J(0). 
01 


3. Surface area for surfaces of revolution: 


(a) A = 27 ү f(x) 1+ (f'(z))? dz when у = f(x) is rotated about 


the x-axis. 


y2 
(b) A = эт | qz 1 (f'(z))? dy when y = f(x) is rotated about the 
yi 


y-axis and f is one-to-one. 


t2 . . 
(c) A= эт | wy Ф? + V? dt for x = 1), у = w(t) rotated about the 
ti 


x-axis. 
(d) A = 2r T ф/ ф2 + 02 dt for x = lt), у = w(t) rotated about the 
y-axis. k 
9% dr V? 
(e) A = 2r A rsin фут? + (=) аф for r = r(@) rotated about the 
z-axis. 
$2 dr \? 
(f) A = 2v J, r соз ф\/т? + (=) Фф for r = r(@) rotated about the 
y-axis. 


4. Volumes of revolution: 


22 
(а) У = т f (a) da for y = f(a) rotated about the x-axis. 


x1 
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(b) V =т us а? Р(х) dx fory = f(x) rotated about the y-axis. 
x1 
y2 
(с) У =т И g^ (у) dy for x = g(y) rotated about the y-axis. 
y 


(d У-т V? à dt for x = g(t), у = Y(t) rotated about the z-axis. 
ta 


(e) V-r Фа for x = Q(t), y = Y(t) rotated about the y-axis. 
tà 


фә 
(f У =т | sin“ ф (% COS © — r sin 2 dý forr = }(ф) rotated about 


аф 
the x-axis. 
фә 
(g) V = "/ соз? ф (= sin ó — r cos ) аф forr = f (4) rotated about 
the y-axis. 


5. The area enclosed by the curve put y^ = a"/*, where a > 0, c is an odd 

20a? [г (51 

D EE 

6. The integral Т = fff z^-1y"m—-12"—! dV, where R is the region of space 
R 


integer, and b is an even integer, is A = 


p 
bounded by the coordinate planes and that portion of the surface (=) + 
a 


4 k 
(2) + (2) = 1, in Ше rst octant, and where fh,m,n,p,g,k,a,b,ch are 
с 


Uniform thin rod Normal to the length, at one 
end 


Uniform thin rod Normal to the length, at the 


center 
Thin rectangular sheet, sides a | Through the center parallel 
and b tob 
Thin rectangular sheet, sides a | Through the center 
and b perpendicular to the sheet 


continued on next page 
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Thin circular sheet of radius r 


Thin circular sheet of radius r 


Thin circular ring, radii rı 
and гэ 

Thin circular ring, radii rı 
and гэ 


Rectangular parallelepiped, 
edges a, b, and c 


Sphere, radius r 


Spherical shell, external radius 
rı, internal radius тә 

Spherical shell, very thin, 
mean radius r 

Right circular cylinder of 
radius r, length [ 


Right circular cylinder of 
radius r, length [ 


Hollow circular cylinder, radii 
ті and тэ, length | 

Thin cylindrical shell, length J, 
mean radius r 


Hollow circular cylinder, radii 
ті and тэ, length | 


Hollow circular cylinder, very 
thin, length l, mean 
radius r 

Elliptic cylinder, length [, 
transverse semiaxes a 
and b 

Right cone, altitude h, radius 
of base r 

Spheroid of revolution, 
equatorial radius r 


Ellipsoid, axes 2a, 2b, 2c 


Normal to the plate through 
the center 


Along any diameter 


Through center normal to 
plane of ring 


Along any diameter 
Through center 
perpendicular to face ab 


(parallel to edge c) 
Any diameter 


Any diameter 
Any diameter 
Longitudinal axis of the slide 


Transverse diameter 


Longitudinal axis of the 
gure 

Longitudinal axis of the 
gure 

Transverse diameter 


Transverse diameter 


Longitudinal axis 


Axis of the gure 


Polar axis 


Axis 2a 


5.3.13 TABLES OF INTEGRALS 


Many extensive compilations of integrals tables exist. No matter how extensive the 
integral table, it is fairly uncommon to па the exact integral desired. Usually some 
form of transformation will have to be made. The simplest type of transformation is 
substitution. Simple forms of substitutions, such as y = ат, are employed, almost 
unconsciously, by experienced users of integral tables. Finding the right substitution 
is largely a matter of intuition and experience. 
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We adopt the following conventions in the integral tables: 


. Aconstant of integration must be included with all inde nite integrals. 


All angles are measured in radians; inverse trigonometric and hyperbolic func- 
tions represent principal values. 


Logarithmic expressions аге to base е = 2.71828... , unless otherwise speci- 
ed, and are to be evaluated for the absolute value of the arguments involved 
therein. 


The natural logarithm function is denoted as log x. 


The variables n and m usually denote integers. The denominator of the ex- 
pressions shown is not allowed to be zero; this may require that a # 0 or 
m + n or some other similar statement. 


When inverse trigonometric functions occur in the integrals, be sure that any 
replacements made for them are strictly in accordance with the rules for such 
functions. This causes little dif culty when the argument of the inverse trigono- 
metric function is positive, because all angles involved are in the rst quadrant. 
However, if the argument is negative, special care must be used. Thus, if u > 0 


then i 
sn “и = cos \/1—и? = свест = —.... 
u 


However, if u < 0, then 


52.52 Б БЕТІ! 
sin“) u = — cos™! V1 — u? = —r свет = —.... 
u 


5.1 TABLE OF INDEFINITE INTEGRALS 


9.4. 


kj 
2. | 
3. | 
a f 
sf 


1 ELEMENTARY FORMS 

аах = ах. 

aa dni a f) di 

өс) ас = | 99) dy, ere y = g. 


(u + v) dz = E da + / тат, where u and v are any functions of т. 


udv —u | dv- | овчо f vdu. 
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pnt 
7. fe dz = RET except when n = —1. 
n 


f (8) = т Е) = "(a X 
о. | EE ae = ов f(a), (d(e) = f (a) da). 


F) eee т т) = f (x т 
w | 7а = Via), (df(z) = f' (x) dz). 


п. f ede =e". 
12. еа = шэн 
а 


13. [V а = ар b > 0. 
alog b 


14. ПО 


15. | ač de= i a > 0. 
log 


a 
1 z 
iG, oe ae 
a? +r? а a 
— ta ұза. 
а а 
17 эг 5 = or 
a? — x 1 
95) LAUS а? > а? 
а а – r 
1 228 
——coth =, 
a a 
18. | Е ог 
1? — a? 1 т—а 2 2 
О ОЁ езү! а” >a’. 
mod. xb 
sin [а]? 
is f = = = ог 
жы - cos" у а? > а? 


da o 5 5 


21. [= = sec! 2 
тух? — a? la a 

2. | —S— Бы (уе. aa), 
туа? + т? а т 


5.4.2 FORMS CONTAINING a + bz 


Я (а + bz)" 
23. = —————— —1. 
3 [a + te) ат (141757 nz 
n = 1 n+2 __ a n+l 
24. К + be)" dx = Pint) (a + bz) Wc (a + bx)", 
пф -1, ný —2. 
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n+3 ШЕТЕН NENIE TE TE |, 
n £ —1, n —2,n $ 3. 


TIS mike п+1 
25. fala + ba)" de = у, [SE (a+br)”t? sala ôs) 


26. [ea + ba)" ав = 


ат 1 
| — = жн 
3 decus b(a + bx) 
29. Гг е, Е 
(a + be)? 2b(a + bx)? 


т [a + br — alog (a + bx)] 


x 
30. | te = ka. А 
P B og (a 4- bx) 
n. | T pi (atb t 
(a+bx)2 " 2 5 + ba 


2 
33. / с 0 (е bz)? — 2a(a + bx) + a“ log азы) 
а HH 


x 1 а? 
4. ар — 2al = : 
3 15 ат D a + bx — 2alog (a + ba) m) 


x? 1 2a a? 
35. ss: ах = т (os (a + bx) + EET ст) . 


2 \a+br 
dx b a + bx 
e] 
z?(a + bx) apr 2 eB 
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a. f ат _ 22-а | 2 
|J ж3(а + br) | 20222 аз балы 
/ ат a + 2bx 2b a + bz 
à. d 
z?( x 


ZEN Lc NEL A | 
a + bz)? a?x(a + ba) ү аз 98 


5.4.3 FORMS CONTAINING с? + z? AND 2? — с? 


43. [= 1 ар 
0+1? с с 


ат 1 сЕ2 2 9 

44. 2-1 37% Q0 Dm 
1 zs 

45. шан. = — log ка, z^ > с. 


12 — с? 2с rcc 
46. | dr 45 log (© аад, 
с? + г? 2 
x 1 
41. | ————— dz = F-2——— | 
| xen e Tono Xa» Hast 
dx 1 x dx 
TE NE NN 
| wm 2c? (n — 1) гоо + @» » / с=т= 
dx 1 т dx 
d a i - (n - 3) | qu 
== мн (22 — c2)n-1 (2n » f c] 
т us 2: 2 
50. | 2—4 = $log (e с”). 


т 1 
51. — dr ---------. 
/ (x? — c2)1+1 Wt 2n(x? — c?)” 


5.4.4 FORMS CONTAINING a + bz AND с + dz 
u=at+bs, v=ct+dz, andk=ad—be. (ЕЕ =0,thenv = (c/a)u.) 


dx 1 v 
52. | — = 21 — ). 
uv k og (7) 
т 1 
зз. | Zas = 5 (Flogu— Slog) 
ат 1/1 а v 
54. | — = = | = + — log — 
и?ъ (2+7 23 
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5.4.5 FORMS CONTAINING a + ba” 
dx 1 1 zvVab 


= —— tan , ab » 0. 
à 


а+ br? уар 
l jg анги „ың. 
2/—аЬ а — ху —ab 
61. [= Tor? or 
a + bx ӯ 
1 tanh7! 2 Sue ab « 0. 
v —ab a 
dr E EN 
вз. | A de = zp tan mE 
т 1 
. | — шү! : 
“Jae ж = > og (a + bx”) 
64. / > „r af dr. 
a + bx 24 b bl acbz? 
в. | ат Є 2 d dx 
(a--bx?)? 2а(а + ba?) 2a J at bar?’ 


1 a + br 
6 ——-— = = lo 
d [=< Dr? 2а% 8 hae 


dx 
67. ee а 
/ (a + br?)m+1 


1 x 2m —1 / ат 
2та (a + bx?)™ 2ma (a + bež)“ ? 
or 


re r—1)! 1 ат 
aid ЕУ гд are 


тах її 
6. ттт сс лор 


x“ dx x 
jú (a + bax?)m+1 2mb(a + bz?) i 2mb / (a + bx?)™? шаа 
ат 1 т? 
70. / а-ы?) | 241% a + ba?“ 


n. f da 201 b dx 
‘J zla +bí?) | ax aj a+ba?“ 


n. | т = or 
x (a + bz)! 1 m а" а? 


© 2003 Ьу СКС Press LLC 


73 | т = al dr -if. 
`J а? (a+br?)®t! aj 12a + ba?)m ae 


ат k [1 (k +x)? —12x—k 
7A. = — [—1 ----- —— = 2/4. 
a + хз За Р B a + br? + VŠ tan куз | : 2 
x dx 1 [1 a + ba? 21 2a —k 
75. — = — |- log ——— 3t ----- ka 2/6; 
[25 4: ов Gags + voten wal b 
а? dx 
76. | — —H ay 1 
6 | == 3b og a + ba? 
dx 
77. —— = 
a + br“ 
k [1, z? +2kr + 2k? -1 2kg a x 1/4 
x [2106 Speer + tan 2k? — a? |" ab>0, k (т) 
or 
k [1 at+k E QN 1/4 
ai og р t tan 2), ab « 0, k (-5) 
в. | 2 nan ab ре 
E 2bk k^ анд 


1 а? Б : 

79. / dz = ug log = lp <0 k= um. 

т? 1 1 т 2 _ Ike + 2k? M 9ka 
sú A i масы ZR 
0 ЕЗІ ax [3 тру ета a. 

ab>0, k= (2). 

a dx 1 k ET е 

NE Abk tog 2 тр + 2 tan 3 ab <0, k = 4/—%. 


x? dx 
в | m = Gp log (a + be“ ) 


dx 1 т” 

вз. | p^ an S m n 7-0. 
84. / dx = Ji dx Е JE x” dx | 

(a + bar)mtt (a + br?) m (а + bxr)m +! 
ss. | а” dx Ға 272 dz е ER 27% dx 

(a + by" )rti m" (a + bz")? b) (a+ br)" 
86. / ат Е Ji ат ob Ji ат 

"(а + banjet aJ x™(a+ br”)? жт="(а + bg” )P+ 


87. [ea + bary? ах = 


TEEN Нэг хн —a(m-n4 р [ea + bary? а) , 


ICI jen (a+ bar? +anp f a" (a+ bo") da! ; 
or 
1 m+ түрі / m+n Жүй 
—— = 1 
m) E (a + bx”) b(m+1l+np+n) | 2" "(a + bx")? 421, 
or 
әт 1) nee + bat + (m +1+ np + mn) | "a + bary? da] : 


© 2003 by СКС Press LLC 


5.4.6 FORMS CONTAINING с? + 2? 


1 + z)? 1 2 
8p nutu (S З ) + fan PE 
с т 3 


3 + х3 6c? c? + x? 21/3 суз 
89 / da _ x " 2 da 
Jo (с Er) 3с3(с3 + 13) 365] c xz? 


ат 1 т ат 
90. / (c? + x3) ^ 3než E + 13)" + (3n — 9 / (c? + E ‚п #0. 


x ах 1 с + až 1 21 22 Fc 
91. = >l + —t А 
/ Ez5 бе $ (cEx) су AS BA 


92. | z dx x 2-3) тах 
(c3 + x3)? НТ: (c + 123) 33 J +r? 
z dr 1 x тат 
9 RU ne mE Ж | 
3 ] rcm сЗ + х8)" БЕТТЕ Un TAI J l Hon 
x? dx 


2 
міна зей 


c3 + хЗ)"+1! 3n(c? + x 


1 x 
9 = —— log ——. 
6; | xem TET 3c? ов c? + x? 
ат 1 1 x? 

өз. Сек ae eg 

/ z(cš + 23)? 3c3(c3 + x3) T Зсб 98 xus 

dx 1 1 ат 

| z(c? + x3)" | 3nc3(c9 + х3)" m c3 / x(c3 + 3)!” Зэ: 

99 / da TRE Е 5/ хах 
“| eler) Bare) (+r) 


100 / ах 3) dx 3) тат 
J EEr Ej) r(e Er) + сз (сЗ + 23)" 


5.4.7 FORMS CONTAINING c* + 4 


ат 1 1 а? + сту? + с? 21 су 
101. | —— = — log | —————“ | + tan : 
c» + Z 2031/2 x? — сту? + с? c? — x? 
dx 1 |1 CHT 212 
102. | -------1-1 ll. 
c+— 1+ 28 8 -T зап 3 


2 
ТЭРЭН ааа! i 
C 


тат 1 c? +17 
104. | ——— = — log ————. 
/ c*—z* 4c кн 2 


105 х? ат БИН! 1, х? = сту? + с? E сау? 
. 2 i^ > |5 los | — Hd | + tan 5 
c + x 2c2 |2 а? + сту? + с? Cae 
2 
106. | LH ENS [596272 - tanc 2) 


c*—z* 2с |2 с-т с 
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5.4.8 FORMS CONTAINING a + bz + cz? 


X —a-c bz + cx? 


If q = 0, then X = c (x + 


a 2cx + b 
UAR ? 1 » 0, 
лө vd 
dx or 
в. f 52 = —2 1 2ст+Ь 
X —— tanh“ 3 4 <0, 
УЧ Ул 
i 2cx +b — /—g 
——log ——___—, « 0. 
4-4 Бост b+ Ta 1 
dx mote 2c T. 
dx 2200 1 3c 6c? dx 
E ЫЕ = x) rie 
2cx +b 3n die 
пах" qn xe 
dx or 
111. X" 
(2n)! ( c Ч ауу (r —1)!r! E 
(n)? \9 q “rex (2r)! 
т dx 1 b dx 
из. f 5 _5т+2а b dr 
xX? qx qJ X 
тат 2a +br ЬЫ(2п—1) f dx 
114. x = > age ч X" n 7-0. 
r dre x b = S. 
2 2 
us. [ 2 dx (6 — 2ac)x + ab 2 ес 
Хх? сах 
z" ат qm n—m+1b fx"! 
117. |---5---------ш-ш---------- ] — dx 
Хен (2n —m -1)eX^ 2n —m-c1cJ X"! 
m—1 a 
2n — m - lc 
dx 1 r? b dx 
ns | = za CX a X 
dx b X 1 dx 
II mx > ш Ge ТД Е 2 315: 
dx 1 b dx 1 dx 
к xe DEDKO Da 32-01 Bor 
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and q= ac — b?. 


2.) 3 апа other formulae should be used. 


тте? 


“Үл 


dx. 


121 dx 2 1 n+m—-1 b 
| 20X01 (m= l)aym-! Xn ^ m- gm жа 


oF aise dx 
|. m-1 aj] ат Хэн! 


5.4.9 FORMS CONTAINING va + bz 

122. | таг = 3 (a + br)’. 

123. | mas = „а-ы (а + bz). 

124. у атгаг = 26а — 120 +1502) (a + Ба) 3. 
125. "Мааа = 


E m A/(a + bx)? — ma | z^ Va brdz|, 


or 
get xd 
p pet ry (Эт +3) (a + ba)". 
va + bz 2 
126. ах = 2уа + bx + [xa 
Ї т 1 Чете хуа + bx 
3 = 
127. Ма + bx la 1 (a + bz) j (2m [у da 
тт (m — 1)a gmt 2 gmat 
us. | dx _ 2Vacbx 
БЕПГЕНГІН b 1 
тат 2(2a — br) 
129. ————5—v . 
ЕТТУ 3p? a + ba 
т? da 2(8а? — 4abx + 3b>17) 
130. = -- 6 
3 ЕЕ 1563 a + bz 
9 Az Pu 
В (2m + 1)Ь [ М т | =], 
ізі: |e or 
Ма + bx 2(—а > ae OCA 
утаа (2r + 1)r!(m — r)!a"“ 
: tan“! Lm а < 0, 
132. | ——— = or 
туа + br Ť 1й ( аласн Е 
va по. | 
133 da _ мат 


12/a +br — ax - END 
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dx 
134. | ——— = 
== 
ма + bx (2n — 3)b 


EI 242 (2n — 2)a J z^-1 Vat be TTE 
OE 


2(a + ba) 2/2 


135. [a + ba)*"? dx = 


b(2+n) 
8 2 [(а+ ba) t7? a(a + ba) 907? 
+n/2 EA _ 
136. fratta) dx = Dm DL 11 0 


137. | ат -2/ ат -2/ ат 
|J zla + bejn/? а) гт(а-%де-2/2 а) (a + be)n/2" 


ii (n-3)/2 
зв. | CH do — f (eto m ase | SE do 


т 


5.4.10 FORMS CONTAINING 4a + bz AND Vc + dz 
and ус + dx 


цал, 0 = с+ ах, k — ad — bc. 


If k = 0, then v = zu, and other formulae should be used. 


——tanh™' : bd >0, «0, 
Vea bu 
2 УЫ. bd >0, k >0, 
> vei du , 
139. v. 1 7” (bv + Vbduv) bd > 0, 
Vuv vad vU 
a y —bduv 
mé аж bd <0, 
4 2bdx + ad + =) 
Билли АЙШЕ ЖІ 
ЛЕ өт || 
2 12 dx 
140. | Vuv dú s | 
| Ser a Virg ve 
EN PEOR. ук kd > 0, 
Vu PU TUE 
w. f PE NES К ж. 4) 
vyu ma 8s — — 7 kd > 0, 
or 
2 Q0 dV 
4 kd <0. 
Уа ука 


142 (ЕЕ _ vuv tj dx 
à V uv bd 2bd 


= Au 
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Juv 
14 — Ч 
3 ЕЕ Ф 2: 


2 _ уш _ k dx 
"ob 2b Juv 


Juu 
uss. | Vet = 78 


1 v" dx 
146. © = = | wu” / : 
fe (шат aga Ми + Е x) 


ME ECCE RUE SE 


2-5 и ee) 


144. 


148. шигээ or 
x 2(m!? /u x (-4)"" Qn). 
b(2m +1)! b (т1)2 ' 


5.4.11 FORMS CONTAINING V2? + a? 
149. [ve + а? йт = 2 | ул? + а? +a’ log (2+ x? + a?)| | 


150. | T = log (z+ ЕТӘ) 
12 Ба 
dr 1 EE 
151. — = — 
Js — а? |а] D 
152 = od quo a ep pt 
`J аут? +až a i т f 


2 2 2 2 
нэ. | 3571 do = V alog (EE). 
/m2 — n2 
154. [eu = V2? — a? — |a| sec“) ын 
т а 
== cT 
155. | de а? ta“. 
1 
156. EET dz = 3 V (a? a’). 
2 
157. | (85547 4с- 1 x @ ras + 2 а аз 


+30 ор (к + x? xw) : 


158 / ат = +x 
J J@te а?у? +a 


—1 


т 
159. | —-———4=-——=. 
/ J (a? + а?) М Vr? + а? 
160. ЇЇЕЛЭ ta?) dz = zh + а?)5. 


2 4 
161. [PV Ee de = t (2 + 97) = ev]? а? — — log (2+ 2? жаз). 
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162. | VE Fa do = $ (32? — 20”) (22 + a2)3. 
1 
163. | Vio =e de = + 220715 (x? — a?)3. 
а? x а? 
LL dcm gx 4 эл? 
ша. | T z Va? Ea! log (т + Vx? Ea). 
x? 1 2 
165. | Zs de = 5 (2? x a?)? Фа ух? +а?. 
Vz? + а? З 
Va? +a? 


dx 
166. | ——— dx = } — 
/ z?z? + а? EE a?x 


dx М? + a? 1 a + ух? +a? 
PE O ay Pg esee ай б 
13/1? + až 2a? x? 2a? т 
a/r2 — a2 1 
168. БХ ЦЭН хээр z sec) =. 

x3 /z? — а? 2a? x? 2|а| а 


2 4 
169. [eve ta?) dx = < (a? + a?)5 F Ve ta?) — ve + a? 


FT log (к + а? ta). 


2 
170. [eve ta?) ах = z (22 + a?) F Ve + а?)5. 


E 24 2 ы 2+ 2 
m. | УЛ а= LY E ов (o + ssa"). 


1 мх? + a? мх? + a? 1 a + Vr? + a? 
72. | М2 9 da=- log (SET). 
т 2x 2a т 
23:02 т? 
173. | Y ао H ise 2 
т 2x 2 Jal а 
Va? +a? J (2? + a?)3 
174. —— — dx = F. 
z^ 3a2 13 
175 Eo эв ЖЭ кір (2+ a? + a?) 
(Jo Xa? + а?)з va? +a? : | 
x? dx а? 
в. | 2 = а? +a? + — —. 
y (1? + a2)? м2? + a? 


т. | dx E 1 221 5 (zem) 
J ауа? +a2)% а?ул? ға? а? R т ` 


ат 
178. | ———=--——-— 
/ гуу (x? — а2)3 a? /z? —a? |а3| 


179 | ds 1 E + a? i x | 
“| 22/0? + а?)3 ад x м2? + a? 
180 dr _ З+а? " ET (у= m) 
DE (a? + а2)3 а/а? + až 2а5 T Ў 
dx 1 3 3 EE 
181 NES эг NENNT SR 
z?4/(a? —a2) а?а? уа? — až Зауал? — až 2 |а| a 
x” dx 1 zi i "E 
182. | === — 7” 12 + a? F ——— — 5 dx 
Vr? +а? т Ж Je? tar 
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x?" dx ТҚ Сон урын e 
183. [5 S = ур йл ужу cen (Fa?) (22)?! 


Шы de log (a + а? + a?) |. 


үлт dg )? 
184. — [2123 Dm) gam ph 
Jone px CER 2x p SE 


185 / dz x vx? + a? (m — 2) dz 
і атут? + a? B T (m — DP i (m — 1)a? хт-—2+\/х? £a? 
= )! 1 192m —2r—1 
EVE Se ——Á— 


(а тч 
уға. уа у= т+1 Pr — 1)! 
2(2r)!(4a2)M—Tažr 


со) 


dx 
186. 
= 1214/1? + a? 


187. f — HÀ ae 

| plete y 
(yr 
22m g2m+1 


88. f — _ © Тэн сз ч 


+ log 


zr? — а? (m)? )Ц4а2 тг түт 
1 s d 
sec =]. 


92m laj? a 


21-52 

ә. | — B LT. 
(z —a)vz? — a? a(x — a) 
2..5432 

о. | — MÀ 

(х +а)ух? —a? а(х +а) 


5.4.12 FORMS CONTAINING va? — z? 


юь [VETE de = s (s a? — x? + a sin“! 2) 
а 


2-і © m 
— sin тт — COS 


dx 
lz —? | [а| Е lal 
=. 
Жи. 


192. 


dx 1 
193. [=-= = —— lo 
туа? — x? a 5 


[272 з з 
194. | 39 — as = VETE? — alog (===). 

ME NEM ота ад 
195. | —À d агар 
196. | куй? = de = -5 (42-22). 

1 За?т 3a“ . ipd 

197. у (a? — 22) de = 3 т (a? —2*) + —— a? — x? + —— sin ia 
198 J- аа 


199. 


эс са 
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200. [eve — 12)3 dx = - Via — 2)5, 
2 
201. [eve - 12 ії = -1 (a? — x2)3 + > (« a? — x + a? sin“! 2) : 
а 
1 2 
202. [eve — 1? dr = c — 5“) (a? — 2). 


5 15 
1 2 
203. [eve = 12)3 dx = 67 (a? — 2?) + = (42-22) 
4 6 
ат "NEU ыр. лы. АА 
ШЕТ: а z+ gg p lal 
1 
204 | ^em = zv amy — T Va? — 17 
2 2 
т x 217 
205 —— dx а? — r? + — sin -- 
f Ма? — r? 2 [a] 
ат a? — т? 
206. ——— = 
0 Tja? — x? a?r 
207. | Уа C 
2 т — sin HL 
т т Jal 
a? — x? ад 21-11 a уа? — 12 
208 / de 35 + zlog ( - ) 
ж [VEE | VET 
g = —— C. 
z^ За? 13 
1“ dx т 12 
210. = їп — 
(a? — x2)3 až — x [а] 
3 
rdr _ 2 2 253 2/42 2 
211 Tae 3 (a? — 1?)3 — z“ уа? — x 
3 2 
212 A ey S 
[277 age oe ge 
31$ к aa e VER OM ЖЕК Se Sde 
J yare 2a? x? 2a3 ^8 т | 
м. | dx _ 1 4, a + va? — x? 
z4/(a?— a?)  a?V/a?—z? а? x 
dx 1 а? — x? x 
215. | —————— = |- 
Гат ай ( шоо т==г) 
216. | dx _ 3 — a“ __3 | a + va? — x? 
z34/(a? — 12)3% а/а? =x? 2а5 2 
т m—1 2 2 -1 2 m—2 
217 / Z _dr=-2 ба EA 2 dx 
Va? — r? m m Va? — x? 
2 m 
д2" _ (2m)! 5 5 т!(т — 1)! 2m-2r 2r—1 
218 a 72 (ml)? —Va“ —x >, 92m—2r+1 (2r)! 
Е 2т 
E 
ШЕРІ sin | 1 
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ы 2үт-т7 2r 
ў -A ——————— (4 2 
219 = 4 уа? 2» uL rd) т 
220 _ ___ varias’ | (т-2 da 
Jo zmaž —12 (т —1)ažx771  (m—1)a? J тт-2,/42 — x2 


m—1 = lan! 192m—2r—1 
221. / dx ЖЫ лет у (m — 1)!m!(2r)!2 | 
т?т 12 “= ( 


Ма? — т? т!)2(2т)!а?т—?т 12741 
dz (2m)! | Va? — х? 22 т!(т — 1)! 
222. [MEME = (шу | a Lame 


1 1 a — Va? — x? 
ортан 08 т : 


dx 
223. > ———— = 
/ (b2 — xr?) Va? — x? 


1 (ba? — x? + туа? — 2)? P NE 
— log | 2———————————— |, а>“, 
2bv/a? — b? b? — x? 
or 
1 —1 «Vb? — a? 2 
— ian ----, b“ >a 
bvb? — а? bva? — x? 
224 / dx < 1 tan"! rva? + b? 
here E Кушти O ттер 
Ма d _ Ма? +2. хуа? +h сат 5 5 
225. = sin —————— — sin —, b >a’. 


02422) БЕГЕН |а| Va? + |а| 


5.4.13 FORMS CONTAINING va + bz + cx? 
X 2a +br +017, q=4ac—b?, and k = 4c/g. 


If g = 0, then VX = vela + Ж. 


1 log (Rave), 590, 


ve va 
or 
da 1 —1 2cx + b 
226. [= = 4 —-sinh“! i c» 0, 
VX ve va 
or 
1 . 12cx4+b 
— sin 5 с<0 
Tu: 
227. de _ 2(2cx + b) 
XVX 4УХ 
ат 2(2ex + b) (x J: 
228. | ——— = + 2k 
X?/X | 3qVX АХ 
2(2ca + b) VX * 2k(n — 1) / ат 
4 (2n — 1)g X" 2n — 1 X" ИХ” 
229. —— - or : 
XX (2er + b) (nl) (n — DM^k"-! XC (2r)! 
q(2n) X 0 (4k X)" (rl)? 
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230. | VY da Qe DV үл de 


4c 2k J VX 
_ (2ca +b) VX 3 3 dx 
231. | хуа = 25 Noo e 26 
2 (са +0) X (үс , 5X 15 5 | da 
232. | х VX dt = T AA) ав VE 
3 [xx = 
(2сх + b) X" VX TE 1 шы 2-4 
4(n + 1)c X" X de, 
or 
(2n + 2)! k(2cx + b) X кылу шкы (4k X)" EN da 
[n + 1)! (4k) 0 (r42)! J/x|- 


zdr VX 5 ах 


z4 qoe E LE | 
VX е УХ 

235. sdr _ Ta + 2а) 
XVX es 


rdc 
236, | EO = ate )X" |. x] gum 
2 — 
237. [ 20 _ (2 5 22) ap к a 


VX 2с Ае? 8с? VX 
2 2. 
238. [2 ат 2 (257 — 4ac)x + 206 $ 1 f dz | 
XVX “УХ cJ yX 
239 x?’ dr _ (2b? —4ac)r +2ab | 4ac + (2n — 3)b 


ХХ | (Оп Dep V/X © (2n — 1)eq SE 1/X 


x? dx а? obr 5p? 2a 3ab 5b? dx 
240. ep a елі; — = ——. 
G 12c? " 8c? 55) УХ цэн E: =) VX 


2" ат _ DUO Gna) — 277) dz шс Гаа 
241. = — VX = L———— ; 
VX ne“ nc VX 
24 -XYE pe ^ "a ат 
2 fr 
n x х — 5 | xa. 
с 


n+1 
м. | 2X" VK da = re УХ -x | VX de, 


(2n ша 2с 
2 _ 
ns. | VX da = 20 У +e [vxa. 
бе 4с 16с2 
T o ^ (EHE, 
—— sin — |, a < 0, 
V 2a | /—a 
or 
246. | ay VA 4220 
VX by C ? 


a > 0. 
x 


1 T ce + bx + м) 
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ух az 2а) т/х 
5 ат dx 
248. ЕКЕНІ ЭЛ 
VX, VX b 
ж./У5 dr =- + ре M 
5.4.14 FORMS CONTAINING 4/2az — 22 


1 5 
250. | аг - do - 5 [e-a 2ax — x? + а? sin ESTE ! 


247. | dx _ VX b dx 


251 [== — or 
! V2ax — x? Е a 
sl (52) 
|a| 

12"/2ax — r? dx = 

n1 /Qaz— 32)? | (2n 1 
B V а On а eS f a= Bar as. 

n+2 n+2 

or 

Voc gH A (2n D) (r!)?an7 n К (2n + 1)!а”*? sin [222 
ГЕТЕ ао) (n +2ут^ 2"^n!(n + 2)! |а] 


253 Г de = . vy Qaz — 1?) (2ax — x?) n—3 | £a. 
1 x" "c E | (2n — 3)a gral 
x” dx 
às [oe Z A _ 
V2ax — x? 
| x" Vax — x? Er a(2n — 1 / dz 
n n уат = а? ” 
or 
(тут —1)la"~" .,  (2n)a" . 1ї(т-а 
/ — 2 МЕЛ) А) om хела do 
2ax — x 2 2-7 (rn т + ИДЕ sin [a] E 


V2ax — x? 2 n—1 / dx 
a(1 — 2п)а"  (2n—1)a J х"—1\/2ах— 2?’ 


SN or 
255. | — aye Q"-" ( и нца 


)?а"- тты” 


2-0 


da 
Var —22) а?уат a? 
257 / хах E z 
|J Qar- av2ax a? 


256. 


5.4.15 MISCELLANEOUS ALGEBRAIC FORMS 


dx 
258. | —————. = log (x +a + V2ar4+ 12). 
] s( ) 
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ax? +с+ 


NIS 
E 
тт 
8 
| 
Б 
S 
A 
© 


va“ 
mt (zva + Vax? + c), a >0. 


x 27 
dr —sin g — y1 — 17. 


MM УЗ Е у 
а” Бат" EG ус 


259. [ve + сах = 


260. / 


К n — 
261. |Z- NE ENS c» 0, 
rar" +c пус Ver 
or 
2 n 
вес”! a ; с<0 
пус с 
1 Ё 1 ( а 
sin 24/-- |, а < 0, 
262. | ш a ? 
„з= == = ог 
мах? +c 1 
1 98 (eva + Уш? +e), a > 0. 
a 


263. nc Lo)? qu = 


а(аа? + c)" *1/7 (әт + 1)c 
2(m + 1) 2(m +1) 
or 


(2 1 2 „m—r 
xv aa? + с Уз ети MEE +c)" 


dE ?rV rm + 1)! (2r + 1)! 


| e 277^ da, 


4 (2m + 1)!c"**! 
22m+1m!( (m+ 1)! —— Fe 
(ax? + c)™t3/2 


264. 2 о)" de = 
Ec + c) dx (2m + 3)a 


2 m+1/2 
265. [pee = 


т 
(ax? + c)? (ax? + c) n- i? 
2m +1 ° z dz, 
or 
c" ^" (ax? + c)" E Ї-22-- 
мах? +c) —>——— 
= ar +1 2 Tc 


da 
266. | ------- 
/ (az? + c) m +1/2 


‚= “Шз ар === 
(2m — 1)с(ат? +0)7—1/2 " (2m – 1)с J (ax? -с)т-1727 


or 
т x 22172171 (m — 1)!m!(2r)! 
Маа? +c <= (2m)!(r!)?e"-" (az? + c)" 


267 / ат . Ма?+с_ (т-2)а ат яа 
`J amar? Fc (m — 1)c1971 (т-1)с/ хт—?\/ах? +c ` 
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268. 


269. 


270. 


271. 


272. 


Л 
b 


|с ға | “та 


1 — 12)V1 + 1+ 2 


1+? 1 (en). 


ах = — log Tos 


1-2 1 21 1V2 


------ dr = = ————. 
1+1?)V1 + zt у2 У1 +2 


2 а 
ута па ма". 


5.4.16 FORMS INVOLVING TRIGONOMETRIC FUNCTIONS 


273. 


274. 


275. 


276. 


277. 


278. 


279. 


280. 


281. 


282. 


283. 


284. 


285. 


286. 


287. 


288. 


: 1 
sin ax dx = —— cos ax. 
a 


I 
соз ах dx = — sin ал. 
a 


1 1 
tan az dr = = log cos ax = 5 log sec ат. 


1 : 1 
cot az dz = — log зїп ag = —— log csc ax. 
a a 


1 1 
ТЕ ax dx = — log (secax + tan ат) = - log tan e + шу. 
а а 


2 


1 1 
Ге ах dx = - log (cscax — cot az) = Ж log tan ES 


8 


ON x 1 : T 
sin“ ax dx = = — — cosaxsinax = = — — sin 20. 
2 2а 4a 


2 


1 
n ax dx = —з (сов ax)(sin“ ax + 2). 
а 


24 
[su ax dx = — 


ӛт Е sin 2ax вїп4ах 
8 4a 32a ' 


820011 
й sin ат совал m-—1 12-25, 
[ow асап------- ns ax dz. 
n 


na 


m—1 2 
m _ соваш (2m)! (т!) ані 
л m=" Or + 1) (ly ^n 
зт ap dy сл 080 T 2m- (тм)? (ost 
Е а (2m + 1)!(r!)? 

r=0 


222 
sin” ax. 


2 2a 2 4a 


1 
cos? ат dr = — sin az (cos? ax + 2). 


cos! az dx = 42 


1 1 1 1 
cos? ах dz = Zx + — sin ag cosar = =g + — sin дах. 


3a 
3 sin2ar | sin4ax 
4a 32a ` 


+ 


1 
cos" ax dz = — cos"! az sin az а ——— | cos”? az da. 


na 
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sin ar 1— (Әт) (11)? "E 
= 22m—?r (2r + 1)!(m!)? 


711 DEREN 


2m+1 Жж sin ат ml)? (2r)! 2r 
COS ax dx = ——— 2. "Qm41 cos ax 


289. | «ойт ax dx = 


290. 


291. 


2 1 
соѕес ax dr = —— cot ax. 
a 


1 COS ax m—2 dx 


292. ™ ax dx = -—— ——__—__ + — | —_—.. 
(Є sin"" ал k соо час a(m — 1) sin""“! ax T m —1J sin"? ax 
/ ат 
1 x 


—1 —2p— 
293 = | cose?” ал dx = 24 579 gom (n — Dim)! 
! а — (2m)\(r!)? sin?" t! az ` 
r=0 
294. ams = Шым ax dr = 
(2m)! (1)? 1 (2m)! 
-F cosa x Pur Dn sir as a Pe (н) 19608 > 
1 
295. E 2Е M йы ax dy = — tanax. 
cos? ал a 
296. | йг = ес" az da = 205 ены ала җы 3 
cos" ax a( 1) cos>lar — m—1] cos"? az 
da d B NEN 5: МИ) 
297. | x шоо [ soc ах dx = " sin ах 2, му) сой la TO 
ат 1 (Әт)! 
298. Бе” = [eee ax dx = а log (sec ax + tan ax) 


1. m)!(r!) 
кл 2. 22m—-?r (m))2(2r + 1)! соз?”+? az“ 


: 0 | Sin(m—n)z віп (т + т)а 2 7 
299. [iu т) (sin пх) ах = m-n) = Amtn) ' m S n. 
300. | (cos ma) (cos nz) dr = I + MR m? з n?. 


301. [iu ax)(cos ат) dr = » sin? аж. 


cos(m —n)z _ cos(m + m)z 


302. [iu m2) (cos nz) dx = — Ой) "nde m? £z n?. 


1 
303. [ow ax)(cos“ ax) dz = "a sin 4ax + c 


4. i Ни = ——————— 
30 [iu ат)(сов” ax) dx (nra 
sin" аж 


305. | вш" ах)(соѕах) dr = (ula 


306. ncs ax)(sin" ax) dz = 
cos"! ax віп" 


(m + n)a Eman 
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307. 


308. 


309. 


310. 


311. 


312. 


313. 


314. 


315. 


316. 


317. 


323. 


cos™* ax m—n+2 1 cos" ax d 
2 мш и нш | nsu EN 
аз EE E - sn n—2 ? 
iae a(n — 1)sin""' ax n—1 sin"? ax 
— - ог 
sin” ат Я Р 
cos"! ax m—1 f cos"? ax 
-.n—1 TÍ е ен ат. 
a(m-—m)sin^ ay m-n sin" ат 
sin”! ax m—n+2 sin” ax 
. a(n—1)cos-lar ^ n-1 соз"—? ат 04 
sin" ax 
[ш к 
цусанд sin"^! ax т — 1 віп"? ax 4 
> —— —— dx. 
a(m -n)cos"-!lay m-n cos” ax 
sin ат 1 sec ax 
5 dt = = : 
соз? ат à COS ax a 
sin“ ax 1. 1 т az 
= —— sin ax + — log tan | — + — 
COS ax a a 4 2 
cos ax CSC ах 1 
—3 ах = — = —— : 
sin“ ат а аш ах 
ат 1 
————— = - log tan az. 
(sinazx)(cosar) а 
ат 1 ат 
——————_ = = secar + log tan — ). 
(sinax)(cos? ax) а 2 
dx _ 1 2 dx 
(зїп ал) (сов ax) ^ a(n — 1)cos"-! ax (sin ал) (cos?-? ax)" 
ат 1 1 т ах 
am = esc az + —logtan | — + ; 
(sin? ал) (cos ат) a a 4 2 
ат 2 
/ > = —- cot2az. 
(sin? ax) (cos? ax) a 


dx 
sin” ax cos” ax 


/ 


_ 1 man | ат 
a(m — 1) sin"-! ax cost! ax m-—1 sin"? ax cos" ax" 
or 
1 mena | ат 
a(n — 1)sin™~! ag cos"! ax n—1 sin” ag cos"? ax" 
1 
ол (а + bz) )dx = —, cos (a + be). 
T: 
cos (a + bx) dx = pom (а + Бх). 
Е ti (e =) 
EL Б zT 27 
тағы ШЕЛ ді 
боот i 27 
T ат 
= —— cot —. 
dI 2 
2 Ў (5) 
Ма? =b? а? -P J’ 
ES ог 
с = 1 atan 2 +b— vb? — až 
b? — a? 5 atan $ +6+ Vb? — а? | 
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2 tan7! ма? — b? tan 2 
—— tan -------- 
ds Va? — 02 a+b , 
324. | = or 
шиг 1 E VU —až tan + a +b 
og | ————————— |. 
B Vb? —a?tan$ —a—b 


325. 21 = 
a + bsin ж + ссоѕ 2 
1 (тышлы 


2 p24 2 
афс, а «bcc 
e EE) е | 


or 
2 -, bt (0 – с) tan$ 2 2 2 
VEET сас с=с Es 

or 


Қаған арал р eM е е ЫЕ ИИ 
а — (b+ с) sin x + (b — с) sin x Б; 


sin“ x 1 /a+b ay a x 
2 . ———À = — е, ales А 
326 | 2-а b "E (/ рез) b ab > 0, |a| > |b| 


dx 1 -і [btang 
327. | ———————— = — 4 : 
/ až cos? r + bžsinž r ab о. ( а ) 


/ соз? ст d ма? +b? OF ı Va? +12 tance x 


1 = ее | 


328. Ел 
Preece РЕ а p? 
sin cz cos cx 1 2 29 
329. ——À3——————,— dx = =~ | b b. 
/ а соз? са + bsin? cr 7 2c(b — a) Өв (aces ce Damen). (ade 
330. соз cx _ 


а соз са + bsin cz. 


da 1 ; 
ae Te +P) (аст + blog (a cos cz + bsincz)]. 


331. [кш sin cx i= 
cos cz + bsin ca 


da 1 
IU OI — al i : 
b pe cla? +7) [bcx — a log (a совст + bsin cx)] 


dx 


332. -------.:-::------- 
a cos? x + 2b cos z sin x + с т 


ja (== у”) Muss 
NEST ctanz +b+ Vb? — ac)" { 


or 
1 zi | 2 
———— tan -——— b“ < ac 
vac — b? (mE Ч , 
or 
1 
= ==, DP = ac. 
сапа +b’ e 
sin ax 1 т_ ах 
-arshin (FF) 
A 1 а se а zT 2 


dz 1 X e 1 ыг. 
4. ши лээ илхэн — jeu. eu ae 
= Hcr ex rS z tan (FF 2) += og tan 5 


dx 1 т ax 1 з/т ат 
Б EN шы єн Le ae es), 
33 їг x 5) m G 2) 
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dx 1 T ах 1 т ах 
386. | а-а аа ri (тэ) + соё (2- 2 22) 
sin ат m т ах 1 3/7 ат 
387. | uy de = — 57 tan (3 229 ) + ga tom G zi 3. 
sin ax ER т ax 1 з/т ax 
ж. / y ge x 2) G 5) 
sin x 
9. = 
9 ] а au 
dx b dx 
Sip Қатты; ES ce 
[ME M n an 5 wore 
bcos x + а / ат 
di (a? — b?)(a--bsinz) а? – 2 J a +bsin x" 
з. [m or 
(a + bsin z) a COS 2 " b / dx 
(02 —a?)(a+bsinz) 2 – а? J a+bsinx“ 
dx 1 _1 (ма? + b? tan cx 
342. | ———— = — tanc! (YS). 
a? + b?sin“ cr асуа? +b? a 
2... 577 
1 — (> b 2! a >b, 
da асма? — b? a 
зз. | —— = or 
9:25 PD ots 2 
ив 1 Құлыны -а ptt), 2< 
R ср. 9 Vb? — a? tan cx — а ! 
TT = x — Ž tan 22. 
1 + cosax 2 
мв. | ==. sca gg dis 
1—cosax a 2 
dx т ах 1 ах 
46: lo —— c] шек pan А 
2 | situs og tan ( E 2) tan 2 
dx ax 1 ax 
| oit 95 an ( m 2] =? 
348 [2—25 = за St tS 
`J (1 +cosarx)? 2 2 ба 2“ 
dx 1 ax 1 зах 
$4 pu cer e c pom раса 
Га 2, 2 ба 2 
COS ах 1 ax 1 зат 
50. | —————— = -- —. 
2 To ds 2a ши 2 ба ta 2 
cos ax 1 a 1 з ах 
51.1------- —.— — —. 
3 а 4 2а со: 2 ба 2 
cos £ 
52, i j ы Мыр. т о. 
: i b ЕСІ 
ат 1 тоот b dx 
353. ------------іооі - ses ===, 
EU v oe an (5 "n 1) “з= 
sa. | dx _ bsin x __а / dx 
`J (a-bcosz)? (b —a?)(at+bcosz) 02 – а? J a+bcosa 
COS 2 a sin т b ат 
Бак Meu мыт ER URP m 
2 ае d (a? — b?)(a + b cos x) жок] 
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356. 


357. 


358. 


359. 


360. 


361. 


362. 


363. 


364. 


365. 


366. 


367. 


368. 


369. 


370. 


371. 


372. 


373. 


374. 


a? + b? —2abcoscr c(a? — b?) 


a? — b? cos? cz | 


1 ax 
хэн шин ee МАК УУ S) 
(cos ax)(1 + sin ат) Fall £ sin az) T 2а Mim ЕЯ 4 


sin ax 1 
— dr = — 1 +1). 
/ (cos ax)(1 + cos ax) шил: pen) 


Е еде lo tan ( Ai) 
sin ax + COSax | - 25 Б 82" 


1 + соѕах + sin ax 


a? cos? cx — b? sin“ cr — 2abc 


To guo eus 


gs = TRE т tan | S CE 
К a—b 2/ 


dx 1 -р atancx 


ан аса 
а? + b? cos?cx | aca? + b? NE /а? +67 


1 6 ^ (REX) f.p 
———— tan ——— а 
e асуа? — b? ма? — ' ; 


or 
1 T СХЕ vb? ==) Pg 
2асу b? — a? B atancz + VD? — a2)" ` 


sin ax 1 
—>DB = F-1 1+ 4 
TG cum dx Tz og( cos ax) 
COS aX 1 : 
Ten ae = +7 log (1 + sin ax). 


| жиш 7 tmuisu xb tan SZ 
(біп ат)(1 + cosax) ` 2a(1+cosax) 2а Б 2 


dx 1 т 


COS ax 1 
ысы ЭГ! +1). 
/ ana T PES (csc ax + 1) 
sin az 1 1 
кене лек нт eei 
[ст то E 2a(1 +sinax) 2а 08 tan 7 T 4 


ЕНЕДІ {ап == 
(sinax)(1 + cosax) ^ 2а(1--соват) 2a 8 2" 


dx T 


dx 1 
= — tan (ax + 1) 


sinax + соѕах)? 2а 


dr =+ log (1 + tan >) 


ат БАЛ! (rr 


btancr — а 


1 x 
xsin ат dx = —, біп ат — — cosaz. 
až a 


2,2 


2x —a“x 
а? sin ax dz = — sin ax + ———— cosar. 
a? a3 
3a 1 —6 . 6x — a? x? 
x sin ax dr = ———— sin az + ————— cos ar. 


a“ аз 


x" sin ax dx = 


1 m 2:1 
--а” cosax +— | x" cosas dr, 
a a 


or 


Їр : 
Se GNU CS 11 
соват : (ТЕКТІ qm + sin ax 


т-ы m—2r Бел т m—2r—1 
(—1)"* m! (—1)"m! 


r=0 
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1 
375. | тсовал ал = — cosax [r — sin ax. 
a? а 


2-2 


2х т 2: 
до cosax dx = — совал + —— sin ar. 
а? 


376. = 


6x . 
377. | х? cosax dr = ———— — cos ax + ———,—— sin az. 
а а 


378. | x" cosaz dz = 


Pc 
T 
"ar 
| 
© 
Ч, 
| 


m 

z 5 111, PES NS 

—— sinax — — | 2" sinag dz, 
а а 


. 54 (—1)" m! т?т [57] (—1)" m! gin 2"—1 
sin ax 2. (т —2г)! — Ory! Posu + cos ax 2, (m2r 1)! ERU ERUIT От 
со 2+1 
sin ax (ат) 
379. dx = —1)L——————. 
/ т^ 24 ) (2n + 1)(2n + 1)! 
COS ал — (ат) 
380. dx = =F 
/ x 24 (2n) (2n)! 
а? x 1 
381. n ax dx = uper sin 2ax — 842 соз 2a x. 
x? а? т 
382. f” sin“ ax dx = ST (= — =) sin 2ат 242 00820: 
383 asin” ax dx cos Зат 1 біп Зат 28 cos ax + sin ат 
: 7742 36a? 4 4 
de. 
384. n ax dx = Я + Jq 511 202 + 842 COS 2ax 
x? x? т 
385. fe cos“ ax dx = gee (5 3 z) sin 2az + 4d cos 2ax 
386 х cos? аха, = Z sin 3 Fl coss spe in dog 
3 ax dx = 19; ax 3642 ax a ax Ta? ат. 
sin ax sin ат а cos ax 
7. = ————— А 
i / gm s (1— m)171 uj gmat ae 
COS ал cos ах a sin ат 
388. dr = —— dz. 
! zm (1— m)27—1 1-т/) ат! S 
x £ COS ax 1 
389. | ——— dr = 1F—— ——— + — log (1 + si : 
f 1 +sinax ^. ШТП + sin ат) "m a? oe US Am) 
т т ах 2 ат 
90. | —————— dx = — 27:38:21 усы» 
3 [ET = бап tu og COS 2 
т т ах 2 ат 
391. | ——— ——— dz = — C cot — + — log sin =. 
/—= T A 2 tig ое 2 
392. / шекелі ат 
1 + cosg 2 
393. / ZENT de = —xcot 2 
1— cos x 
2sin ax 2/2 ax 
394. | V1 — cosaz dx = —-—————— = — — cos —. 
/ av/1 — cosax a 2 
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2sin ах 2/2 ax 
395. | v1 + cosaz dr = —= = — sin —. 
/ ау1 + соѕах а 2 


For the following six integrals, each k represents an integer. 


"a т т m 
2 (sin 5 — cos), (8k — 1)5 <a € (8k -3)5. 


з. [ VIE Ane de = or 
—2 (sin 2 — cos 2), (8k +3)Z < < (Sk +7)Z 
2 (sin 5 +005), (8k — 3)Z < x < (8k +1)E, 
зөт, | VTZ Ain de = or 
—2 (sin 5 + cos 2), (8k +1)2 < x < (8k +5). 
V2 log tan 2 4kr < x < (4k + 2)т, 
зов. | аг А 
A ———— = or 
SUM V2log tan 7, Ak +2)т < z € (4k + 4)r. 
F V2 log tan (21), (4k — 1)т < z € (4k + 1)m, 
зоо. | -=-= or 
V1 + cosg 
— Vlog tan (27), (4k + 1)m <a < (4k + З)т. 
: V2 log tan (7 — =), (8k +1)2 « x € (8k + 5)2, 
HH 
аю. | 2 — = or 
= 
ме —У1овїаа(®— =), 6k+5)3 <z < (8k + 9)3. 
" V2log tan (= + =), (8k —1)2 <a < (8k + 3), 
a 
w. | ďa“ or 
үт 
m —v2log tan (2 + =), (8k +3)2 « x € (Bk 4- т). 


1 
402. n ax dx = ^ tan ax — 2. 
3 1 2 1 
403. | tan“ ax dx = — tan“ ax + — log cos ax. 
2a a 


1 1 
404. n ax dr = — tan“ ат — —-tanaz + x. 
3a a 


1 


405. Д = ——— 
ax dx amc 


an" ax — pow ax dx. 
2 1 
406. | cot” ax dx = —— cot ax — r. 
a 
3 1 2 1 : 
407. | cot ах dx = —— cot“ ax — —logsin ал. 
2a a 
4 1 3 1 
408. | cot атах = —— cot” ax + — cotax + x. 
3a a 


1 
409. | cov" ax dx — — ) cot" ах — [roo ax dx. 


a(n —1 


ao. f - ы de= | zes? azde = - 
sin“ ax 


x cot ax 


1 log si 
+z og sin ат. 
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ап. f - de= | гене ах dx = — шы 


sin" ax 


a(n — 1) sin"?! ax 


SCRAP: TOREM NEN [ue 
a? (n — 1)(n —2)sin"T“ax  n—1J sin""?ar ~~ 


1 
412. / СИНУ Е n ax ах = = tan ах + PU log cos ax. 


cos? ах 
т x sin ат 
413. dr = | xsec” ax dx = —— ———— 
cos” ax a(n — 1) cos"-! ax 


_ ge 2 / т 
a?(n – 1) (п – 2) соѕ%-2ат т-1/ соз"—?ахт 


ат. 


414 sin ал da = —+ тті bcosax 
| м1 + bžsin? ax ab VI+ 
415. | — a — dp ee log (b cos az + V 1 — b? sin? az). 
V/1 — b? sin? ax ab 


416. [iu ax)V1+4+ b? sin? ат dr = 


1+ ы 
Ed» НТ + b sin”! bcos aa 
а ab 


2 2 


м1 + 


417. [iu ax) V 1 — b? sin? ax dx = — a V 1 — b віп? ax 


418: | — de = 
м1 + 02 sin? ax 
419 COS AX 


421. | (cos ах) М1 — b sin? ar dx = 


V/1 — b? sin? ax 
420. | (cos ах) М1 +b? sin? ar dx = 


2a 
2 
В log (b cos ax + V 1 — b? sin? az). 


Ťa 
2ab 


1 : 2-2 
2196 (bsin az + V1+b біп az). 


ab 


1 
— sin“) (bsin ax). 


2a 
1 
+—— log (bsin az +V1 b? sin? аг). 
2ab 


5 1 e . 
== 1 — b? sin? ax + Sak біп”! (bsin az). 


For the following integral, k represents an integer and a > |b| 


422 


суа-% 


424. n тах = 


425. (К = 


/ dx = 
`J Vat btan? cx 


1 
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sin“) CE (4k — 1)$ <a < (4k +1)3, 
a—b. 
\/ л 23 (4k +1)5 <a < (4k + 3)5. 


sin [(n — 2k)1] , 1 
(n — 2k) + on 


is sin [(n — 2k)z] 
k 


n р : 
B x, п 15 ап even integer. 
2 


( 2k) ^ n is an odd integer. 
Үрээ 


n is an even integer. 


n—1 


-— 221 Gln sin ([(n — 2k)(3 — z)]) Й . 
426. [su x dr = 5121 2 Н FUROR 0 n is an odd integer. 


5.4.17 FORMS INVOLVING INVERSE TRIGONOMETRIC 


FUNCTIONS 
ГА Бер] 
427. | sin“) агас = ззат ax + V TEL, 
a 
[474232 
428. | «от аав = cos"! az — Meque 
а 


429. [5 ax dx = x tan“ ax — E log (1 + а?а”). 
a 
z 2 1 
430. n Тал Ал = x cot ax + 25 log (1 + a“ x“). 
а 
2 E 1 
431. Ге "ax dx = x sec“ ат — — log (а + a? 1? — 1). 
a 
Е = 1 
432. Ге "ax dx = сөс ax + — log (а + a? 1? — 1). 
a 
433. / (зї! =) dr = теп) Z + уа? – 2?, а> 0. 
а а 
434. / (совт! 2) dr = z cos“) 2 — ма? —1?, a > 0. 
a a 
435. / (tan! =) dx = хап! 2 — Z log (a? + x“). 
a a 2 
436. / (сос! =) dr —rcot 2 + © log (а? + x“). 
a a 2 
2 1 E 
437. [ sin ! (az) da = ad (Car? — 1) віп! (ax) +axV/1 — а?а?) : 
а 
Ж 1 Ж 
438. ЇЕ 1 (ax) dx = Яо (a^a? — 1)cos^! (az) — ax /1— аза?) . 
а 


i 1.11 1 a grt! 
439. fe sin (ax) dx = "dl sin (ax) = Wd / Gane ах, n X —1. 
Ў Pu T a Pu 
440. fe cos az dz = nel cos (ax) + nE У1-02:5 dr, n z —1. 
at 1+ а?а? J т 
441. | «ва (ax) dx = 217028 tan (ax) — 24 


n+1 n4-1 
42. | i tan“ (ax) de = Sa! (aa) = | үгээр 48 
n 


1 252 
443. (БЕ (ax) dx = — cot (az) + 59 
n+1 n+l 
444. | x” сос! - 2 a —— БЕ 
fe cot (ax) dz STET cot (az) + S] IFOR dx 
23 БУР i 
віп” (ax) 1— V1— а?а? sin ^ (ax) 
445. EL — alog (x зан, 
o jure t 1+ м1 = а?а? 
446. [x dx = —— cos“) (ат) + alog (ees). 
т т т 
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447. 


448. 


449. 


450. / (бас GAY йк гары A da 254277) 
а 
451. [ow (ax))" dx = 
(ал Guay OV OE Lor set өнімді / бие ľa йк 
a , 
or 
TR ЕН „с 
(ыу z(sin“ az)" ^7" + dip. е 1 =ч (sin“ az)^ 7-7! 
24 (131) ХИСА cau | 
452. n (ax))” dz = 
1 — 029-2 
a(cos“! (ағу) — “(cos (ax))"“! — n(n — 1) / (совт! (azx))" ? dz, 
or 
La (-1)"n! 1 2 18 тіу1 — а?а? 1 2r—1 
Ы - n—2r үг = n—2r— 
2. aj e ax) > (—1) (nca d) (cos az) 
sin! аг АЕ 2 
453. Aye ах = 2а (sin ax) 
Ti m S n—1 n 
454. 2 == = Ta V 1 — а?л? sin " ax + A 
а?т 
n—1 / алт? sin“ ax 
na? V1 — а?а? 
NET 
cos ax 1 
455. VICE ах = (соѕ ах) 
x” cos! ax grt CEDENS z" 
456. “Л а? uu bod x^ COS au за. 
n—1 / алт? соз ax dz 
na? V1 — a?r? ` 
tan“! ax ЕЗ 2 
457. / Irar dr ae (tan ах) 
cot lax 1 
458. / DII Sm (cot ах) 
2 
459. | soc ах dx = + sec lag 542 а222-1 
n+1 1 т” 
460. 5 ах = _———=@. 
| =" е ах dx n ай эсс eae 
461. if a алы = sec! ax " a?r? — 1 
т т т 


1 (ax) s a 1--а?т? 
zi dr = ——tan (ax) — 21% (+). 
= 2 
(ат) = a 
z? dr = cot™ (ax) 5 log pam) 
J —ažr1ž 
7! (ах))? dz = г(віһ” (ал)? — 2a + M біп”! (az) 
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2 
1 
462. | зєв” ade = ©; ес”! ax + 5 V a?1? — 1. 


2a? 

n+1 

463. fe свс az de = = 
n+ 


csc 


“аг гүү 
о 21? — 
ма, [ 85554, - - е ar _ Ма?т | 


5.4.18 LOGARITHMIC FORMS 


465. ШЕ = z log x — Е. 


т? т? 

466. zlog zdz = -> logs — =. 
3 3 
467. | 2? log ade = f loge — Z- 

3 9 

grt! жен 
468. "1 - 1 ———3: 
6 fe og x dx nd орх (541) 


469. n z)“ dx = x(log ж)? — 2z log £ + 22. 


470. n x)“ dx = D 


471. [a = 


1 
(log z)? | (log a)“ 
an. [г = log (log x) + log x + 5.9) aap 
473. = log (1 : 
У | ов (log г) 
44. f йз „м 1 ‚п#1 
a( 1 


z" dx m+1 mad 2" dz 
g5, ЕЦЕ: i. жасама М 
шс эх mo] с 


m+1 1 n 
SEPTIES». cf | toga)" de, 


(p +1)? + 02 

. „+! . 

x? sin (blog x) dx = 11715 [(р + 1) sin (blog x) — b cos (blog x)]. 
log (ax + b) dx = ат ый 


477. ЇЇ: cos (blog x) dx = ЕЕЕ СЕ [bsin (blog x) + (p + 1) cos (blog x)]. 
/ log (ax + b) — x. 
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во. | EE ae = ЕЕЕ Эрхий, 


b bx 
1 "n b m+1 
зи. [т log (ax + b) dx = ml x — (-2) log (ax + b) 
E: (b т+1 S (-22] 
т +1 a 207 b 
m—1 
вз. [ 210 ао + 1 = "ER: 
ge m—1 тт-і m—1 b 
m—2 


483. [ log ZES de = (v + a) log (2 + a) — (a — a)log (е — a), 


x —a 
mi tà pri E stl = gmt 
8 fe og == г mol og (x + a) GET og (z — a) 
[2 
далы Е 1 тұт-2ғ-?2 
т+1 4 msi ; 
1 2-ға а-а 1 а? — а? 
ы ПЕ ов _— д т Sta a т? 
For the following two integrals, X = a + bx + cx?. 
486. | log X de = 
v 4ac — b? ep. 
(«+ $) tog x — 20+ У-У tan їг b? — Дас < 0, 
2с с V4ac — b? 
or 
b b? — Дас сі 2cx +b 2 
+ |log X — 2r + ——— бап ————=, b – 4ас > 0. 
( x) : с Vb? — 4ac 
n+1 n+2 n+1 
т 2с 2 b т 
487. | x" log X dx = log X — ДЕБЕТ V хее Е =, A 
8 Ї» og Хат cp 8 al ae al у аж 


488. n- (x^ +a”) dz = zlog (a^ + a“) — 2x + 2a tan“) 2 


© +a 
r—a 


489. Joes (22 — a“) dx = «log (£? — a“) — 2x + alog 
(2° +a”) log (17 + a“) — за, 


491. [ log (2+ т? + а?) dz = т1ов (a + a? xa?) — va? kaž. 
өз. | log (к + 2? + a?) de = (+2) log (2+ Poa) we se 


490. n (17 + a?) dz = 


NIdÓ 


2 4 


gmt 
Ци 2 2 == 2 2 
өз. [т log (2+ x Ea?) de = 5— log (« + т ta?) 
1 gmt 
al“ 
m +1] уа? Ea? 
"T = (z+ va? +07) log (a + Va? + a?) 1 ot Ут TE 
1 ------------(--------------- ee атақ ағ 
ж? x a x 
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13 / log (ж + Vz? — a?) 2 log (a+ V2? — a?) 
x ————————— а = ————— 


x? x a 


496. at log (z^ — a“) dx = шах ss log (z^ — а?) — а" log (x — a) 


5.4.19 EXPONENTIAL FORMS 


497. fe dz = e”. 


498. [v mg. 


499. | аг = ас 


NE „(ax — 1) 
a 
ге m m-lga? dy, 
a a 
ви, f: те dg = z 
mix?" 
ax cp 
€ 24 ) (m — r)lar 
4 2,2 3,3 
е ar ах 
а кз. 1 qe 3i p*a a Tees 
so. | de LÁ tn a mA ті. 
1—-mz"-!  m-—1J 2" 
ам fe "Ме in i da. 
a а т 
505 сг = z — log (1 + e7) = lo е 
“J 1+e% 7) 5 = BT Fer 
dx т 1 
506. | -------і 221, 
06. | or ART og (a + be"“) 


dx 1 —1 ma a 
507. | ——————— = —— — : 
? / ae"? + berme mvab Эн Č (9) ааа 


1 ma __ 
log Vae"? — vb , a>0,b>0, 
dx 2mvVab Vaemz + vb 
508. | ———H—H— = 
0 l= - ber me P 
——{апһ ^! | je). а> 0, b» 0. 
таб 5 
Р a“ +a” 
509. P exquo. —2—— 
Га а ) ат 524 
er” 
51 = — 1 em 
o f LL x og (b + се“) 
ge?” pre 
511 = 
f (1 + ax)? a?(1 + ax) 
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-а2 1-22 
512. f ге ^ de = —5e d 2 
ат s e°” [a sin (bx) — bcos (bz)] 
513. fe sin (bx) dz = O е 
2[а? + (b — c)?] 
ае ант тест атган 
2[а? + (b + c)?] ! 
шешуш (р сан хий! 
2[а? + (b — с)? 
2[a? + (b + c)2] i 
Ea a 


514. / e^" sin (bz) sin (сх) dz = 


о 
Е 


515. ?* sin (bz) cos (cx) dz = 


516. | e^^ sin (bx) sin (bx + c) dz = 95 Da? + 467] 
ais _ e*sine е [asin 2bz + c — 2b cos2bx + с] 
517. | е sin (bx) cos (br + c) dx = Эс + 2 [až + 407] ! 


ах 


ax е 
COS (bx) dx = FUNT 


[a cos (bx) + bsin (bz)]. 


о 


e^? [(b — c) sin (b — c)z + acos (b — c) z] 


519. | e°” cos (bx) cos (cx) dz = zla? F (6 — 9] 
Р e^? [(b + с) sin (b+ c)z + а сов (b + c)z] 
2 [a? + (b + c)?] | 
ad _ €"*cosc е“ [a cos 2bx + c + 2bsin 2bx + c 
520. | e^? cos (bx) cos (bx + c) dz = 25 t 2 [až + 457] 
a 2 _ е sinc е [asin 2br + c — 2b cos2bz + d 
521. | e^? cos (bx) sin (bx + c) dz = DEVE + 2 [až + А 
522. | e“? sin" (bx) dz = 5р [(a sin (bx) — nbcos (bx))e%* sin"! (bz) 
n(n — 1)? «e ? (ba) а) : 
523. Тэн cos" (bx) dx = 2-2 | (а cos (ba) + nb sin (bx))e“" cos"! (bz) 


tnn- y [ee 97 (be) de. 


1 
524. fare sin x dr = 27 € (sing — cos x) — Л far le” sin z dx 


525. pores sin bx dz = x" e^? шаш) гс) 


a? + b? 
m m—1 az 5 
ET fe e“* (asin (bx) — b cos (bx)) dz. 
т.т 1 m лүш: m т-і 20 
526. [т е cos zdr = от е (sine + сова) — m fa e” sin r dr 
m п" е" cos z dx 
527. | « теат cos by йд = r” e22 808 (bx) + bsin (bz) 
а? +b? 
EET 2" e** (а сов (bx) + bsin (ba)) dx. 
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528. / е cos” z sin" z dx = 


€** (cos! x) (sin? x) [a cos x + (m + т) sin x] 


(m+n)? + a? 
TT e** (со8”7 z) (sin"“) z) dx 
m —1)(m +n ax m— MGR 
AT / е (сов 5 z)(sin т) dz, 
or 
€** (cos™ x)(sin"“) x) [asin z — (m + n) cos z] 
(m+n)? + a? 
Vera яа e** (со8”7 z) (sin"“) z) dx 
n—1)(m+n ab 3 ЗГЕ 
аста) fe (сов x)(sin"“ x) dz, 
or 
ед“ (cos! z) (sin! x) [asin r сова + msin” x — n cos? 2) 
(m+n)? + a? 
m(m — 1) атут ‚п 
(m +n)? + až e (cos x) (sin 2) dx 
mn — 1 ax m - n— 
uA fe (сов x)(sin"“? x) dz, 
or 
е (cos! z) (sin! x) [asin r cos x + msin“ x — n cos? 2) 
(m+n)? + a? 
Lu [ex z)(sin"^? z) dx 
HU Je" (cos" z)(sin"^? т) dx. 
529. / ze“ sin (bx) йк = EO [asin (be) — bcos (bz) 
EIER [(a“ — b“) sin bx — 2ab cos (bx)] . 
530. fo cos (bx) dx = стр [а cos (bx) + b sin (bzx)] 
NEM: (а? — b“) cos bx + 2absin (bx)] . 
531. / ёс? шид е [asin z + (n — 2) cosa] a? + (n — 2)? / e^? dz. 
sin” т (n — 1) (n — 2) sin"! x (n —1)(n—2) J віп"? x 
e^? е [a cos x — (n—2)sinz] а? + (n — 2)? / ез? 
532. dax = ————ÀMÀ—————— M ——————[——— dm. 
155 т (п-1)(п-2)сов"-іт Шш (n —1)(n —2) J cos^-? x » 
n—1 
533. fe tan" x dx = етап ш — per tan”! z da — / e** tan”? z dx. 
n—1 n—1 


5.4.20 HYPERBOLIC FORMS 
534. | stuha dx = cosh x. 


535. | cosh z da = sinh z. 
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536. n x dx = log cosh x. 
537. | ова dx = logsinh r. 
538. nz da = tan“ (sinh z). 


539. foha dx = log tanh (2) 


540. [sinh a do = z cosh x — sinh 2. 
541. jú: sinh z dx = x" cosh x — n f 7 (cost x) dr. 
542. | «вон adx = xsinh x — cosh x. 
543. fe cosh z dx = x" sinh x — n | a" (sinha) dz. 
544. / sech x tanh x dx = — sech x. 
545. / csch x coth x dx = — csch x. 
inh 2 
546. ns x dz Be 52. A 
547. / sinh" r cosh” x dz = 
sinh""*! x cosh"“ x + quedo [smn zcosh" шат, m+n 40, 
m+n mtn 
or 
: m—1 n+l m — 1 : m—2 n 
sinh rcosh"" x — sinh z cosh" тағ, т+п ж 0. 
m+n mtn 
dx 
548. | ——————— = 
/ (sinh"" z)(cosh" г) 
1 m+n—2 / dx 
= —————————— — ————— [ ————————— dae, m 41, 
| (m — 1)(sinh""“ z)(cosh?^! x) m—1 (sinh”~? x)(cosh" z) 7 
or 
1 m+n—2 dx 
_+-—[{[-———— dx, 071. 
(n — 1)(sinh"^! x) (cosh"“) x) n—1 | (sinh™ x)(cosh"“? т) * 
549. ns тах = x — tanh z. 
n—1 
550. ЇЇ tanh” тах = I + / (tanh"““ x) dz, n 1. 
ms 
551. | soch? тах = tanh т. 
inh2x 2 
552. һ? A Ж. 
/ cosh“ тат 1 + 2 
553. | соч? zdr = x — coth z. 
n—1 
554. | «аг тах = A + fow тат, nz |l. 
mcs 
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555. ns тах = —cothz. 


556. ІШ mz )(sinh nz) dr = 


557. [cost тт) (cosh nx) dr = 


558. ШІ mz )(cosh nz) dz = 


sinh(m +n)x  sinh(m — пут. ww 
2(m +n) 2(m — n) 

sinh (m+ n)z , sinh (m — n)z 2 2 
2(m +n) 2(m—m) 5 43 

cosh (m + n)z , cosh (m — na nixus 
2(m + n) 2(m — n) 


559. / (sinh! 5) dx = «sinh! = — Vs? +a, а> 0. 


—1 
csch ! z dz = x csch 


А 


1 z 
2+5 


v . —1 
x + — sinh 


41-23. 


2 2 
560. | x ван”! Ť) del Ep EA si Bu an A SU 
a 2 4 a 4 
. Ё get! : = 1 pnt 
561. | z^ sinh 1212 = „nr.“ gc] aa п Ф —1. 
" zcosh ! 5 —A/z?—a?, cosh“! 220, 
23) сов”! = dg = or 
zcosh ! 2 + Vz?—a?, cosh“ž <0, a>0 
563 fe (сова?! =) ах = а” - а cosh! = — 2 4/22 — а? 
і а 75204 a 4 
n+1 1 n+1 
564. fe cosh”! z dz = poh 1-1 — 14e пф —1 
565. / (т 5) dx = x tanh“! 5 + 219% (a? — 2”), |z| «1 
566. / (совт 2) dx = x coth“" = + 2 log (1 — a“), [2| 21 
a a 2 
EE 
567. | z (гаг Z) йк = — " inh! 4+, «1 
568. | x" tanh“ zdr = as tanh“ PE цан —— dz, п#—1. 
1 n+1 Itre 
2 Қыша 
569. Ї» (сот?! =) ах = coth = [2| > 1 
n+1 n+1 
570. | z" cod! кат = coth e] I$ 2 т 4® п -1. 
571. [ soch! x da = vsech ! x + sin“! x. 
2 
1 
572. f + soch“! тах = Z sech™' z — 2У1 — 2. 
n+1 1 n 
573. i icd 1 sh s o | Emm de ný -1 


2 
ax csch“ zde = > csch“ 


© 2003 by CRC Press LLC 


2 || 


n+1 


576. fe csch“! zdr = = csch“ g + 
n+1 


1 т / a” d 3d 
——— | —da, ng —1. 
nctliz|/ VIF ^ 


5.4.21 BESSEL FUNCTIONS 
Z, (1r) represents any of the Bessel functions (J, (2), Y, (2), Kp(z), Ip (2)). 
577. / РЇЇ Z (1) dz = а (ж). 
578. / 22 Z (a) dx = в? Zp (2). 
579. / donas de = а [[Zp(ax)]? — Zp—1(az)Zp41(az)] . 
580. / Zda Ste) 


581. ТЕСЕ dr = xZ)1 (x). 


5.5 TABLE OF DEFINITE INTEGRALS 


582. / 771675 de = Г(п), Ren > 0. 
0 


со ! 
583. ! zp“ dx = КОТЫ р > 0, n is a non-negative integer. 
0 р 


со 
exc des Г 
ЖЭ x” le METRE n>0, a > —1. 
0 


(a +1)" 
: 5 T(n +1 
EN i Г(т) Г(п) 
5 (1 — z)” 1 - Lr. cca co IDEEN) . 
2 2) dx = | (boje tr Pan £n) n>0, m>0 


талаа Г(т + DT(n +1) 
T(m+n+2) ^" 
m > —1, n>—1, b >a. 


ч Ж Goa ira ре) 


588 — = m >1 
1 1" m-l’ 
со 
589. | 177 = тсєзсрт, 0<р<1 
0 
со 
d 
зоо. | ae —тсо{рт, 0<р<1 
0 
x? 


gp 


оо „0—1 
ses. | Edda s qme 
o 1--2 sin рт 


1 р 1 b= р 
592. | i dx = / ( 2) dx = —т cosec pr, —1<p <0. 
0 0 
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594. 


595. 


596. 


597. 


598. 


599. 


600. 


601. 


602. 


603. 


604. 


605. 


606. 


607. 
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е 
a з 
vat) п> -—1 
al , 
2-1 855) 
т/2 т/2 ын ў 
| 2x вае f cos" zda — ү (n= ET т # 0, n is an even integer, 
е 6 n! 2 
or 
— 1)! 
ш x) ; n #1, n is an odd integer. 
т! 
Е а> 0, 
or 
0, a — 0, 
or 
= а<0 
= оо. 
т 
= E a > 0. 


т 
117 
ko 
| 
Ls 
їе 
ГА 


sin ах od 


COS шар, 


uL 


eo {апат ах ч 


1+7 = sin BE 0 « m « n. 
pp meten (go) r(e- ag) 
de = т v > E 0 
(т + x^) b T'(c) 
a>—1, b>0, m>0, c> &H. 
y? ат 
T. 
(1+ х)ут 
T 
27 а> 0, 
оо or 
— z dx = 0, a —0, 
a“ +x or 
m a<0 
a a 
2 2,т/2 = 1 2 2\n/2 E n! T аты 
(а — x“) а= | 56 — x“) ЖЕ , 


а > 0, n is an odd integer. 


а> 0, m>—1, n> —2. 


(nz) sin (mz) а= | cos (nx) cos (mz) ах = 0, 
0 


т + m, nis ап integer, m is an integer. 


7T 
sin (nz) cos (nz) dx =]. sin (nz) cos (nz) dr = 0, n is an integer. 
0 


sin ax cos bz dx = 


2a 

a2 — b2? 
or 

0, a — bis an even integer. 


a — bis an odd integer. 


608. 


609. 


610. 


611. 


612. 


613. 


614. 


615. 


616. 


617. 


618. 


619. 


620. 


621. 


622. 


623. 


624. 


625. 


Г 
Г 


or 
3 т 
ӨШ. созат ке. T jal = 1, 
т 
or 
т 
2? [а] <1 
та 
IE 0<a<b 
sin = bx da = E 
T T 
3 0<b<a 


7T 7T 
me 2 T n Я 
sin“ mz dr = cos mz dx = эр misan integer. 
0 0 


9% sin? pa т |p| 
І 12 ат = 7957 
sin Z 4 т 
=a, 0<p <1. 
HE ~ ЭГ(р) іп (pr/2) С” 
COS x | т 
L——————,0«pc«l1. 
| ~ 2T(p) cos (pr/2)" ^P 
со 
qe 
Ї OSP q did тір! 
2 
0, q>p>0 
or 
т 
А о z p>q>0 
or 
T 
T p=q>0 
cos Mae — |ma| 


mds. 
sme = 21063 
Ял ae = Эт 
Sint da т. 


dx cos la 
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өв. | = бс RN ME 
o а-+Ьсозт a? — 2 
25 ат 2т 
ГОК uu Ja k 
І 1--асовт T 1 — а? lal 
ex. | ас аа Р 2) 
0 т а 
т/2 ат Е 
629. PN T PEE. idtm 
ri а? sin? т + b? cos? x 2 [ab] 
630 ГИ =н i A 
“Jo (ažsin? х + b? cos? x)? 7 40363” ; 
т/2 1 
вм. | віп") z cos"! gdr = =8(5) > 


m is a positive integer, n is а positive integer. 


U aa (2n)! | Aer’ 
632. / sin" z dz = тапап» "is a positive integer. 
т (2n + 1)!! 
m 2n — 1)! 
633. / sin?” z dx = SAGT n is a positive integer. 
Т !! 
7/9 Ж 1 1 1 1 
634. dr 22[—-——34+—3—— +...|. 
И sin x“ (в qu р стан ) 
т/2 
635. ! dz a = E Tn is a non-negative integer. 
о l+tan" x 4 
т/2 (9т)3/2 
636. | Мсоз x dz = 
0 (г(1/4))° 
т/2 " m 
er. | tan“ gdz = mo 0<h<1 
0 2 cos (25) 
"/2 tan?! az — tan“) b 
638. | шингэн Ээ oS es DES 
0 x 2 b 
5% =@а 1 
639. е dz = —, а>0. 
0 а 
00 TAT _ еге” b 
вю. | ——— dz =log-, ар 0, Б> 0. 
5 z a 
T 1 
5 тер, а> 0, п> —1, 
641. / ze dr = or 
0 n! ! ТЕ ЕТ 
"E a> 0, n is a positive integer. 
99 22 ЇЕ 1 
вр. | ve Өдөн tD, a>0, p>0, п> —1. 
0 рак P 
ын 1 
643. / е9 de= m, a > 0. 
0 2a 
| —aa? 1 T 
644. e dx = 3V7 erf (bva), а> 0. 
0 а 


645. f E702“ de = 3) |Z erfc (ba), a > 0. 
b a 
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со 3 1 
вв. / ze” ак = =. 
0 2 


вп. | der dr= ут 
0 4 


648. [Г бағ yg CRODH SE S dd 
Ü 2(2a)" а? 


со ! 
sa». | 2916—99 dy = 5H a>0, п> —1. 
0 


1 1 п. o 
т —ac шини ze : а 


r=0 


651. Ж giu ma fu) dgr = em 
2 
0 


652. | eco 0/2?) de = И а> 0, b> 0. 
0 2V a 
Ra —а@ 1 
653. / vre dz = —,/—, a > 0. 
0 2aV a 
со oa т 
54. -4/- : 
6 | um dx 2 а> 0 


ш а 
655. e ** cosmx dz = ——— , а> 0. 
a? + m? 
= bei 
“(Ге * cos (bx + c) dx gl, a > 0. 
657. е в® sin me dr = ————у, a > 0. 
0 a? + m? 


bcosc + asin c 


658. І e ^* sin (bx + c) dz = р > 0. 
vag сч 2 

659. | те ^" sin бе ат = ( зуе а> 0. 
оо а? = b? 

660). І те 9" cosbr dx = TIENE а> 0. 


n! [(a + 0)" — (a — ib)"+1] 


m n —ar 21 = [ 
661. І x'e "віп ba dx = аға уыт » а> 0. 
C E n! [(a — ib)" ** + (a + ib)"^*!] 
2. 2 ae = SNV EET Č = 
66 f те “© cos bax dx 2(а? 4 bH , a>0,n> 


663. [= АЕН ИРЕ 

664. T 2j cos bx ат = AT exp P / (44^) ab > 0. 
0 2 |а] 

665. / eT? 9959 1071 sin (z sin ф) dr =T (b) sin (бф), b > 0, к= <9 < 5. 
0 

666. / e71 0891071 cos (x sin b) dz = T(b) cos (bý), b>0, -3 <4 < Z. 
0 


ser. | 17 cos z dz = T (b) cos (2) 0461. 
0 
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668. / x“) sin z dx = T (b) sin (2) 0<b<1. 
0 
1 

669. / (log z)" dx = (-1)"n!, n > —1. 
0 
mde cc ут 

70. log — dz = ——. 

6 | og = ат 2 
1 1 n 

on. | (os 1) dx = nl. 
ó z 


1 
en. | z log (1 — z) ах = —-. 
0 4 


1 
673. | z log (1 + х) dx = 9 
0 4 
1 n 
674. / x” (log x)” dr = oe. m > —1, nis a non-negative integer. 
0 ис А 
1 log л т° 
75. ———. 
: | rg 479 
2 
676:| 282 ds T. 
o 1-2 
1 2 
өт. | log (1+2) , Edd 
0 x 12 
1 2 
678. / log РЕ S 
0 т 6 
1 л? 
e». | (log x) log (1 + x) dz = 2 — 21062 — iS 
0 
$ л? 
680. / (log x) log (1 — x) dr = 2 — Зо 
0 


1 logg п? 
1. = ——. 
68 / TET. dx 8 


! l+a\dx т? 
682. l — = —. 
og (152) т 4 


1 
1 
өз. / ОБУ dg = -2 log 2. 
: 2 
1 


У1-22 


" 151% Г(п--1) 
4. 1 — = —— —1 —1. 
68: І 2 ое (+) da (m4 1j m»-l,n» 
1 aP 24 p+1 
5. = log | £— ed e. 
68. 1 177 dx og (222), р»--1, q> 
Рр ат 
вво. | -———— = vr 
o log (— log x) 


со e* +1 л? 
өз. | log (S45) de - 7: 


т/2 т/2 
688. f log sin z dx = / log cos zdr = — 
0 0 


т 


2 log 2. 


7/2 7/2 
689. / log sec r dx = / log cosec r dx = 21% 2. 
0 0 
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т п? 
690. / x log sin z dx = —— 10g 2. 
0 
т/2 
691. | (sin z) log sin x dz = log 2 — 1. 
0 
т/2 
692. | log tan x dz = 0. 
0 


а>Ь 


т /n2 — p> 
es. | log (a + bcos x) ах = т log (oe), 
0 


Е 21loga, а> > 0, 
694. / log (а? — 2abcos x +“) dx = or 
0 271056, Ь>а>0. 


^ sinag т ат 
695. dx = — tanh ——. 
І sinhba 25“ 315] 


696. / кышы s Қы 
0 


cosh bx 2b 2b“ 
697. / ЭЕ И 
о coshar  2la 
со т т 
698. dx — -- > 0. 
/ sinhaz | 2а 44 


воо. | e ^? cosh (bx) dz = 
0 


а 

a? — b?" 

700. / e ^? sinh (bx) dz = E |М <a. 
0 а 


2 b2’ 
99 sinhax т ат 1 
u І іт age 73, 220 


99 sinhaz 1 T an 
702. = — — — -- > 0. 
| ст] 28 Эс Эр 0851-8240 


т/2 
тоз. / Lo dr ____т 
0 1— k?sin?z 2 


7/2 
a йе 
о (1—kžsin“ x)3/2 2 


7/2 m 
705. / V 1 — к віп? x йт = 
0 


№] 
үзээ 
um 

| 
ч 
Dole 
NZ 
N 

Банн 

N 

| 
ч 
n 
da | Go 
wo Vy 
N 
м 


706. | e`” log z dx = —7. 
0 


ът. | с log zde = — Y* (4 + 21og2). 
0 


59 1 LY =; 
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* 


тә. | + (5-3) ах = x. 
о 2 \l-e* т 


5.5.1 TABLE OF SEMI-INTEGRALS 


(1) 


(2) 


(3) 
412/3 


(4) 3/7 


(nl)? (ac) 1/2 


s |z”, n= 0,1,2,... Qn4 I) RT 


p = Г(р--1) р+1/2 
© | 22, р> —1 Inr" 


=1 


в) = tan“! (1/7) 

ша 2sinh^! (мт) 
4/т(1--а) 

(10) e? erf (1/7) 


(1) е? — 1 

тас Vra (4/2) 
7 VH a (VT) 
a | si rel (л) 
as) vx La (Vv) 


E Vf Ho (уз) 

an ут. (Мт) 

ав 2\/® [log(4x) — 2] 
o» vi log (1) 
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5.6 ORDINARY DIFFERENTIAL EGUATIONS 


5.6.1 LINEAR DIFFERENTIAL EGUATIONS 
A linear differential eguation is one that can be written in the form 
b, (z)yC9 + by a (уу d + +++ 6. (ауу + bo(z)y = R(z) (5.6.1) 


or p(D)y = R(x), where D is the differentiation operator (Dy = dy/dx), p(D) is 
a polynomial іп D with coef c ients {b;} depending оп т, and R(x) is an arbitrary 
function. In this notation, a power of D denotes repeated differentiation, that is, 
Dry = а" у/ах". For such an equation, the general solution has the form 


у(х) = уһ(2) + Yp(-) (5.6.2) 


where y,, (©) is a homogeneous solution and у (x) is the particular solution. These 
functions satisfy p(D)y;, = 0 and p(D)y, = R(x). 


5.6.1.1 Vector representation 


d 
Equation (5.6.1) can be written in the form E = A(x)y + r(x) where 
z 


7 0 1 0 0 0 
y! 0 0 1 0 0 
п 2 
y= y , A(x) = т И r(x) = 
: 0 0 0 1 0 


5.6.1.2 Homogeneous solution 


For the special case of a linear differential equation with constant coef cien ts (1.е., 
the {b;} in Equation (5.6.1) are constants), the procedure for nding the homoge- 
neous solution is as follows: 


1. Factor the polynomial p(D) into real and complex linear factors, just as if D 
were a variable instead of an operator. 


2. For each non-repeated linear factor of the form (D — a), where a is real, write 
a term of the form се, where c is an arbitrary constant. 


3. For each repeated real linear factor of the form (D — a)"", write the following 
sum of m terms 


суе®® + coge? + cgr e"? pak OA (5.6.3) 


where the с, 8 are arbitrary constants. 
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4. For each non-repeated complex conjugate pair of factors of the form 
(D — a +ib)(D — a — ib), write the following two terms 


c1e!? cos ba + cs e^? sin bz. (5.6.4) 
5. For each repeated complex conjugate pair of factors of the form 
(D — a 4- ib)" (D — a — 4)", write the following 2m terms 
c1e"* cos ba + coe“ sin br + esae?" cos ba + caxe"" sin ba: +... 


+ Com 11771618 cos ba + сое sinbz. (5.6.5) 


6. The sum of all the terms thus written is the homogeneous solution. 


EXAMPLE For the linear equation 
y? — 14у'® + 819? — 252y + 455y — 474y" + 263y — 60y = 0, 


p(D) factors as p(D) = (D — 1)? (D — (2 + 1))(D — (2 — i)) (D — 3)(D — 4). The 
roots are thus (1,1, 1,2 + 4,2 — 1,3,4}. Hence, the homogeneous solution has the 
form 


т(а)- (со + сх + cox”) €" + (сз sin x + са cos x) 7 + ЗЕ + cee“? 


where {co,... , Ce | are arbitrary constants. 


5.6.1.3 Particular solutions 


The following are solutions for some specic ordinary differential equations. In 
these tables we assume that P(x) is a polynomial of degree n and 4а, Б, p,q, r,s} 
are constants. In all of these tables, when using “cos” instead of "sin" in R(x), use 
the given result, but replace "sin" by “сов”, and replace “cos” by “— sin". 

The numbers on the left hand side are for reference. 


If R(x) 18 A particular solution to y — ay = R(x) is 
0) e"* f(r — а). 
Q) —2sinsppscosse — — (a? + gy sin (sa + tan“! £). 
Е) -1 [ро + 22 £39. b ЕЈ 


(4) Replace a by a — r in formula (2) and multiply by e"“. 
(5) Replace a by a — r in formula (3) and multiply by e"“. 
(6) — sin sx [ete PG) + day (а) 


k — k = 
Уа" ?s? (ауа 4 4 


po EE OTO АСР 


8 


— COS se [fr Pr) + r Ра) 


күйесі (Ryu а 


+++ ETT UE TP (a) 4..... 


m Replace a by a — r in formula (6) and multiply by e"“. 


continued on next page 
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— continued from last page 


If R(x) is A particular solution to у' — ay = R(x) is 
ett те 


(8) 
е“ cos sq 
(9) ----- 
8 
ао) eer pe ал. 
e°” sin sx [p p" po 
(11) [eet TE 


е cos sx " (4) 
ees [pg P, Pes]. 


12 IEEE 
(12) (r — a)? 


(a? — s?) sin sz + 2as cos sx 
(a? + 82)? 


1 
= Wage sin Č + tan“ 
a S 


(13) 


1 2as 


1 әр! ” (т) 
(14) 3 |Р) + 2 20 EIE +... „ Ge). 
(15) Multiply formula (13) by e"“ and replace a by a — r. 
(16) Multiply formula (14) by е”? and replace a by a — r. 
: 2.52 228,22 
(17) sin sr | гн PG) + 24-34. Ра) 


enna] 


+s 


+ cos sz | 2-Р (2) + 2347855; P'(r) 
B Arum 


pente opos ous - ш еы 1Р2 (1) +... 


(18) Multiply formula (17) by e"“ and replace a by a — r. 


(19) 


(20) 
82 
QD ед f? f" P(z) dz dy. 


е sin sx " (4) 
шш pij зеш 4 SPO) 4 J 


(22) — 
32 


€^? cos sz 2Р(х) АР”(а) | 6PO (а) 
-—— |S LEM +... 


52 
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(23) 


(24) 


ж 32" 

(26) (r? — s? + фе" sin sx — 2rse"* cossz 

(ese + a)“ + (2rs)? 

e" 3 _ 
р тт M ur ) + dis P" (2) 
uic d 1G) Gert pen) +...) 

ов | P(x) si epo- dE t P" (a) 

+ (—1)* C eis POB + 


5 СО5 SX 2P' (а) 45” 34 
As A P" (a ) 
COS Hee ee pat-D (s) F.. 1 


(4—52)2k—1 


(29) 
(30) 


P" (а) 
— 025)2 


(31) 


r?+pr +q 
Ё (4-82) sin 82-0р8С08802 __ 1 : ( 2 —1 ps ) 
(32) “--а-774(р447 - = Л Тур? sin | sx — tan Тэ 
2 2 
өз Цра)-ЕрҚа)- 54Р" (а) - £m P" (a) 


quu (C COP He Cs eo pea]. 


(34) | е”? si Multiply formula (32) by e"“, replace p by p + 2r, and replace 
qbyg- prr. 
G5) Multiply formula (33) by e"“, replace p by p + 2r, and replace 


qbyq+pr +r’. 
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If R(x) is | A particular solution to (D — a)”y = R(x) is 


(36) е" (т — a)”. 

37) ce IC - (аз 2а pla at —.. 5 sin sx + 
(anis + (Z) +... ) соз sa ; 

(38) ср" [Р@) qug Bano ob m | (+з нь... |: 


(39) 


(40) 


5.6.1.4 Second-order linear constant coef cient eguation 


Consider ay” + by! + cy = 0, where a, b, and c are real constants. Let mı and m» 
be the roots of am? + bm + c — 0. There are three forms of the solution: 


1. If m and m» are real and distinct, then у(х) = c1e"1* + c4 er2* 

2. If m4 and m» are real and equal, then y(x) = 167717 + coxe™!? 

3. Еті = p + iq and тә = p — iq (with p = —b/2a and g = V4ac — b? /2a), 
then y(x) = е?“ (cı cos qx + c» sin gx) 


Consider ag" + by" + cy = R(x), where a, b, and c are real constants. Let m1 
and m» be as above. 


1. If m4 and m» are real and distinct, then y(x) = Cye™!* + Co em 
10717 / (m; — ma) [^ вт" R(z) dz + e"?* / (ma — m1) [^ e-"?* R(z) dz. 

2. If mı and m» are real and equal, then y(x) = C1e"1* + Core™!” 
+re™? f* е-тт* R(z) dz — e? f” зе 1* R(2) dz. 

3. If mı = p + iq and ma = p — iq, then y(x) = е? (cı соз @2 + ca sin qz) + 
eP? sin qz/q [^ ес?“ R(z) соз qz dz — e”? cosqa/q [^ ег?“ R(z) sin gz dz. 


5.6.1.5 Damping: none, under, over, and critical 


Consider the linear ordinary differential equation z” + px’ + x = 0. If the damping 
coef cien t и is positive, then all solutions decay to x = 0. If jj = 0, the system is 
undamped and the solution oscillates without decaying. The value of u such that the 
roots of the characteristic equation А? + uA + 1 = 0 are real and equal is the critical 
damping coef cient. If џ is less than (greater than) the critical damping coef cient, 
then the system is under (over) damped. 

Consider four cases with the same initial values: y(0) — 1 and y'(0) — 0. 


1. y^ -3y +y —0 Overdamped 

2. y" +2y'+y Critically damped 
3. y" +0.2y' +y = 0 Underdamped 

4. y" +y —0 Undamped 
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Illustration of different types of damping. 


undamped 
underdamped 
critically damped 
overdamped х 


To 


5.6.2 SOLUTION TECHNIQUES OVERVIEW 


Differential equation Solution or solution technique 


Autonomous equation 

fy“) yD, TAA y”, у, y) = 0 
Bernoulli’s equation 

y + f(x)y = g(a)y” 
Clairaut’s equation 
f(zy'—y) = 900) 

Constant coefficient eguation 
aby“ + a1y"7) +... 

+ En —1Y" + dny == 0 
Dependent variable missing 
PAY ug хай ae) SU 
Euler’s equation 
aga” у" + aya” tyr) +... 

+an-iry +any = 0 
Exact equation 
M (z, y) da + N(x, y) dy = 0 
OM ƏN 
ду да 
Homogeneous eguation 
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Linear first-order eguation 
y + f(z)y = g(x) 


with 
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Change dependent variable to 
Change dependent variable to 
One solution is f(zC — y) = g(C) 


There are solutions of the form 
y = х*е^®. See Section 5.6.1.2. 


Change dependent variable to 
ша) = y'(2) 


Change independent variable to z = et 


Integrate M(x, y) with respect to x 
holding y constant, call this m(z, y). 


-——— + C unless 
—v 


fv) 


f(v) = v, in which case y = Cz. 


Differential eguation Solution or solution technigue 


Reducible to homogeneous 

(aiz + Ьу + ci) ах Change variables to u = a,x + biy + c 
+ (ast + boy + со) dy = 0 | andv = azg + boy + с 

with aj /a» # bı /ba 


Reducible to separable 

(air + biy + ci) dz Change dependent variable to 
+ (aga + boy + со) dy —0 | u(z) = aiz + у 

with a; /a2 = by /ba 


Separation of variables / dy / 
— = x)dz + C 
y'= fGr)g(y) ТЕ БА 


5.6.3 INTEGRATING FACTORS 


An integrating factor is a multiplicative term that makes a differential eguation have 
the form of an exact equation. If the equation M (z, y) dz + N(x, у) dy = 0 is not 
in the form of an exact differential equation (i.e., My # N,) then it may be put into 
this form by multiplying by an integrating factor. 


1. If & e — ax) = f(x), a function of x alone, then u(x) = exp (f^ f(z) dz) 


is an integrating factor. 


2. If t e — ax) = (у), a function of y alone, then u(y) = exp ( f” g(z) dz) 


is an integrating factor. 


EXAMPLE The equation 2 dz + dy = 0 has {М = y/x, N = 1} and f(a) = 1/z. 
z 


Hence u(x) = ехр(/° + dz) = exp (log x) = x is an integrating factor. Multiplying 
the original equation by u(x) results in y dz + æ dy = 0 or d(xy) = 0. 


5.6.4 VARIATION OF PARAMETERS 


If the linear second-order equation L[y] = y" + P(x)y' + Q(z)y = R(x) has the 
independent homogeneous solutions u(x) and v(x) (1.6., L[u] = 0 = Шә), then the 
solution to the original equation is given by 


у(2) = —u(x) / ае dx + v(x) / A dz, (5.6.6) 


where W (u,v) = uv! — u'v = | p | is the Wronskian. 


EXAMPLE The homogeneous solutions to y” + y = csc x are u(x) = sin z and v(x) = 
cos x. Неге, W (u,v) = —1. Hence, у(х) = sin zlog(sin x) — x cos x. 

If the linear third order equation L[y] = y” + P»(z)y" + P(z)y' + О(шу = 

R(x) has the homogeneous solutions yı (x), y»(x), and y3 (x) G.e., L[y;] = 0), then 
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the solution to the original eguation is given by 


0 y» 0 и 0 y 
0 y % и 0 y 
R y) wi и R yj 
y(x) =ne) | тугу itp) | 0 Bas 
W (y1, y2, уз) W (y1, уо, ys) 
(5.6.7) 
y y 0 
y 0 
yi yv R 
tula) | do 
W (y1, уз, уз) 
yı уо уз 
where W (ул, уо, ys) = |1 ¥2 Уз | is the Wronskian. 
i Y2 93 


5.6.5 GREEN'S FUNCTIONS 


Let L[y] = f(x) be a linear differential equation of order n, on (то, 21), for y(x) 
with the linear homogeneous boundary conditions {B ;[y] = хоо (ауу (20) + 
ыу ©) (a1)) = 0}, for i = 1,2,...,n. If there is a Green's function G(a; z) that 
satis es 

L[G(z; z)] = ó(x — z), 


B.[G(z; z)] = 0, ES 


where ô is Dirac's delta function, then the solution of the original system can be 
written as у(х) = f G(x; 2) f(z) dz, integrated over an appropriate region. 


EXAMPLE To solve y" = f(x) with y(0) = 0 and y(L) = 0, the appropriate Green's 
function is 
шэн for0 € x € z, 


G(z;z) = L 5.6.9 
SaS 208529) for z € z < L. ! i 


Hence, the solution is 


y(x) =| G(x; z) f(z) dz = jE: 28-0 f(z) dz + | шин 2) f(2) dz. (5.6.10) 


5.6.6 TABLE OF GREEN’S FUNCTIONS 


For the following, the Green's function is G(a,€) when 2 < < and G(£,x) when 
TRE 


. Фу А 
1. For the equation — = f(x) with 


dx? 
(a) y(0) = (1) = 0, G(z,£) = —(1 — )z, 
(b) y(0) = 0, y'(1) = 0, G(z, £) = —r, 
(с) y(0) = —y(1),y(0) = —y(1), С(2,6)- (2 = 6) — i, and 
(d y(—1) =y(1) = 0, G(z,£) = —3(z —£ - zé + 1) 


© 2003 by СКС Press LLC 


d? 
2. For the equation 22 — y = f(x) with y nite in (—oo, oc), 
т 


G(a, ©) == -le* s. 


d? 
3. For the equation = + Ку = f(x) with 
T 


(а) y(0) = y(1) = 0, СОО E ш 


ksink ? 
(b) y(—1) —y(1),y(—1) = y(1), and G(z,£) = cos k(a ~€ +1) 


2k sin k 


d? 
4. For the equation 223 — k?y = f(x) with 


_ sinh ka sinh k(1 — €) 


(a) у(0) = y(1) = 0, G(a,§) = pane i | 
b) y(—1) = y(1), у'(—1) = y'(1), and бүгд O 


5. For the eguation E (272) = f(x), with y(0) nite and y(1) = 0, 
x 
С(г,6) = Iné. 


2 
6. For the eguation £ е? - my = f(x), with y(0) nite and y(1) = 0, 
2 2 


G(z,£) = -z [(£ 


da dx 1 — 12 
m/2 
nite, G(x, €) = -z (H n) „(m = 1,2,...) 
E d^y К П П 
8. For the eguation mé“ Ка), with y(0) = y(0) = y(1) = y(1) = 0, 
1; 


G(x, €) = -ZED (ane + x — 36). 


5.6.7 TRANSFORM TECHNIQUES 


Transforms can sometimes be used to solve linear differential equations. Laplace 
transforms (page 585) are appropriate for initial-value problems, while Fourier trans- 
forms (page 576) are appropriate for boundary-value problems. 
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EXAMPLE Consider the linear second-order equation 4" + y = p(a), with the initial 


conditions y(0) = 0 and y (0) = 0. Multiplying this equation by е” *”, and integrating 
with respect to x from 0 to oo, results in 


/ cya) do + | суа) = | e ““р(г) ах. 
0 0 0 


Integrating by parts, and recognizing that Y (s) = Lly(x)] = eT"y (x) dz is the 
Laplace transform of y, this simpli es to 


уб) = f^ epla) de = £pi) 
0 
If p(z) = 1, then Z[p(z)] = 877. The table of Laplace transforms (entry 20 in the 


table on page 606) shows that the y(x) corresponding to Y (s) = 1/[s(1 + s“)] is 
y(x) = £^! [Y (5)] = 1 — cos z. 


5.6.8 NAMED ORDINARY DIFFERENTIAL EQUATIONS 


1. 


10. 
11. 


Airy equation: у” = ry 
Solution: y = су Ai(z) + со Bi(z) 


Bernoulli equation: y' = a(z)y" + b(z)y 

Bessel equation: z^y" + zy! + (Ma? — n?)y = 0 

Solution: y = ci Jn (Ах) + сҮ, (Ax) 

Bessel equation (transformed): xy" + (2p + 1)zy! + (227^ + 8?)y = 0 


Solution: y = x? lo лут (že) te, (28) а= ур? = В? 
r 


T 


Bôcher equation: y" + 5 | mi p... Pci | y' 


1—01 1—n—1 


1 AotAiz + + Ara 2 
+ Анту - 0 


Duf n gs equation: y" + y + ey? = 0 


Emden-Fowler equation: (2? y’)’ + z^y^ = 0 


2-а 2-с 


i T EN !o | 126-8! | 1-3-7 үүл 
Hypergeometric equation: у + (== + = + =| y 


_( о 4 BB U Yy (а—Ь)(ф—с)(с—а) — 
(= а)(б—еў + (-b(e-a] | (:-)(а 5) (z-a)(s- bsc) = 0 
a b c 
Solution: у= Páka 8 ~y ғ) (Riemann’s P function) 
a! 8! jy 


Legendre equation: (1 — z?)y" — 2xy! + n(n + 1)у = 0 
Solution: y = ci Р, (x) + сә0, (ж) 


Mathieu equation: y" + (a — 2g cos 2x)y = 0 


Painlevé transcendent ( rst equation): y" = 6y? + x 
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12. Parabolic cylinder equation: y" + (ax? + br + c)y = 0 


13. Riccati equation: y’ = a(x)y? + b(a)y + c(x) 


5.6.9 LIAPUNOV'S DIRECT METHOD 


If, as x(t) evolves, a function V = V(x) сап be found so that V(x(t)) > 0 and 
OO) < 0 for x Æ 0, then the system is asymptotically stable: V[x(t)] > 0 ав 
t Es оо. 


EXAMPLE For the non-linear system of differential equations with a > 0 
: 2 : 2 
11 = —аФу— 2172, 22 = —ax%2 + 21292, 


dene V = 22 + тз. Since V = -2а(а2 + 22) = —2aV we nd V = V(x(t)) = 
Уое” 24%, Hence xı (t) and x>(t) both decay to 0. 


5.6.10 LIE GROUPS 


The invertible transformation {7 = $(z, y, a), 


group if ó(z, 9,6) = Ф(т,у,а + b) and /(т 
these transformations become 


v/(z, y, а) } forms a one-parameter 


y= 
7,59) = (a, y,a + b). For small a, 


E=a+a€(x,y) + O(a?) and 7 = у + ап(ж,у) + O(a?) (5.6.11) 


хыг the in nitesimal generator is X = Elz, y) & + п(ж, у) 22. If D = 2. + 


y' 5 +y" 2 3,7 + -- • then the derivatives of the new variables are 


2.4) Dv datyvy 
dro Dó | фа + y'óy (5.6.12) 
"ODP Р, Р, "I А 
т”. B ыз кеш е еа ау, 
ат Рф фа t y'óy 


= P(z,y,y'. a) = y' «ай + O(a"), and 


where 


2 
Q = D(n) - v'D(£) = nz + (ny — &)y' -у 6, and 
~ = D(G) — y" D(£) = Nze + (27у - бал + (Nyy T 2829)“ (5.6.13) 
3 
20 Eyy + (Ny — 26; — Зуу” 

The prolongations of X are ХО) = X + л and XO = ХО) + (5 | For 
a given differential eguation, the different in nitesimal generators will generate an 
r-dimensional Lie group (L,.). 


For the equation F (x, y, y', y") = 0 to be invariant under the action of the above 
group, X©)F |р-о- 0. When F = y" — f(a,y,y’), this determining equation 
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becomes 


Па + (дву — бау + (Nyy — ауу — буу 
+ (my — 2& — 3y'&)f — [n + (т = &)y - y^ fy 
= ¿fs —nfy = 0. (5.6.14) 
Given the two generators X1 = ад + ms and X4 = a3 + më, the 
pseudoscalar product is X1 V Хз = £i] — €211, and the commutator is | Хү, X2] = 


XıXə — X5 X1. By a suitable choice of basis, any two-dimensional Lie algebra can 
be reduced to one of four types: 


No. Commutator | Pseudoscalar | Tried by 


[X1,X2120 | УХ, #0 


[X1, X3] = 0 X4 V X» =0 
[X X] =X EXE NE Х» #0 
[X1,X2] = Хї X4 V X» EU 


5.6.10.1 Integrating second-order ordinary differential equations 


An algorithm for integrating second-order ordinary differential equations is given 
by: 


. Determine the admitted Lie algebra Ľ,„, where r is the dimension. 
. If r < 2, then Lie groups are not useful for the given equation. If r > 2, 
determine а subalgebra Lə C Ly. 

3. From the commutator and pseudoscalar product, change the basis to obtain 
one of the four cases in the above table. 

4. Introduce canonical variables speci ed by the change of basis into the original 
differential equation. Integrate this new equation. 

5. Rewrite the solution in terms of the original variables. 


Ne 


5.6.11 STOCHASTIC DIFFERENTIAL EQUATIONS 


A stochastic differential equation for the unknown X (t) has the form (here, a and b 
are given): 


dX (t) = a(X (t)) dt + b(X(t)) dB(1) (5.6.15) 


where B(t) is a Brownian motion. Brownian motion has a Gaussian probability 
distribution and independent increments. The probability density function f x (;) for 
X (t) satis es the forward Kolmogorov equation 


2 fx) (ж) = l2 [b (x) fx (o) (a)] = 2. [а(ж) fxe) (x)| . (5.6.16) 
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The conditional expectation of the function ¢(X (t)), u(t, z) = E[@(X(t)) | X(0) = 2], 
satis es 


: P na) + a(z) ult, a) with u(0,x) = ¢(x). 


(5.6.17) 


5.6.12 TYPES OF CRITICAL POINTS 


An ODE may have several types of critical points: these include improper node, 
de cient improper node, proper node, saddle, center, and focus. See Figure 5.1. 


FIGURE 5.1 
Types of critical points. Clockwise from upper left: center, improper node, deficient improper 
node, spiral, star, saddle. 


5.7 PARTIAL DIFFERENTIAL EQUATIONS 


5.7.1 CLASSIFICATIONS OF PDES 


Consider second-order partial differential equations, with two independent variables, 
of the form 


2 2 2 
A(x, y) + B(x, EH + Cla, y) 28 = Vu, 94, 88 ny). (574) 
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ГЕ: -4АС »0 
If 


B? —4AC <0 


hyperbolic] 


elliptic 


B? —44C = | at some point (x, y), then Equation (5.7.1) is | parabolic | at 


that point. If an eguation is of the same type at all points, then the eguation is simply 


of that type. 


5.7.2 NAMED PARTIAL DIFFERENTIAL EGUATIONS 


. Biharmonic equation: 
. Burgers’ equation: 


. Hamilton—Jacobi equation: 
. Helmholtz equation: 


. Laplace’s equation: 
. Navier-Stokes equations: 
. Poisson equation: 


. Schrodinger equation: 


к. = 
— OO 0 NV 0 л ыы 


. Sine-Gordon equation: 


— 
к5 


. Tricomi equation: 


— 
UJ 


. Wave equation: 


A 
AR 


. Telegraph equation: 


. Diffusion (or heat) equation: 


. Korteweg de Vries equation: 


Vu = 0 
Ut uus = Vlny 


V(c(x,t)Vu) = u, 


Vi + H(t,x,V4,,...,V4,) =0 
Vžu +k“u —0 

Ut + Ugee — 044 = 0 

Vžu —0 


u, + (u: V)u = УР +V%u 
Vžu = -4лр(х) 

— у? +V(x)u = ihu, 

Una — Чуу + sin u = 0 

Uyy = УЧтт 

«ЗУ? = ug 

Une = аин + bu, + cu 


5.7.3 TRANSFORMING PARTIAL DIFFERENTIAL EQUATIONS 


To transform a partial differential equation, construct a new function which depends 
upon new variables, and then differentiate with respect to the old variables to see 
how the derivatives transform. 


EXAMPLE Consider transforming 


foo + fyy + ef, = 0, 


from the (z, y) variables to the fu, v} variables, where {u = x, v = 2/0}. Note that 
the inverse transformation is given by {x = u, y = u/v}. 
First, de ne g(u, v) as the function f (x, y) when written in the new variables, that 


(5.7.2) 


is 


аја (> =) 222) 


Now create the needed derivative terms, carefully applying the chain rule. For example, 
differentiating Equation (5.7.3) with respect to x results in 


Ў (2,0) =%ў- (u) + g2 (v) -а Č (a) +g (2) 


1 v 
= gi + 92— = gi + —92, 
y u 
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where a subscript of “1” (“2”) indicates a derivative with respect to Ше rst (sec- 
ond) argument of the function g(u, v), that is, gı (u,v) = gu(u,v). Use of this 
“slot notation” tends to minimize errors. In like manner 


9 9 a 9 
PICARD ШЕЕ (ш) + ае (v) = Ф э (®) +999, (2) 


т 
“үрээ = EL 


The second-order derivatives can be calculated similarly: 


fs) = д sera = ре (а + е) 


Finally, Eguation (5.7.2) in the new variables has the form, 


20 v? 2v? v) v? 
911 + —gi2 + 75922 | + | ——92 + 75922 | + (u) |——» 
u u u u u 


2 2 2 2 
® (20 — u 2v v (1+v 
= к, 3 A КОЗ QM Te) 5 Л ав 

и и 


u 


5.7.4 WELL-POSEDNESS OF PDES 


Partial differential equations involving u(x) usually have the following types of 
boundary conditions: 


1. Dirichlet conditions: u = 0 on the boundary 
2. Neumann conditions: ou = 0 on the boundary 
3. Cauchy conditions: u and да speci ed on (һе boundary 


A well-posed differential equation meets these conditions: 


1. The solution exists. 

2. The solution is unique. 

3. The solution is stable (1.е., the solution depends continuously on the boundary 
conditions and initial conditions). 
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Type of eguation 


Type of boundary | Elliptic Hyperbolic Parabolic 
conditions 


Open surface Undetermined Undetermined Unigue, stable 
solution in one 
direction 

Closed surface Unigue, stable Undetermined Undetermined 

solution 


Neumann 


Open surface Undetermined Undetermined Unigue, stable 
solution in one 
direction 

Closed surface Overdetermined Overdetermined | Overdetermined 


Open surface Not physical results | Unigue, stable Overdetermined 
solution 
Closed surface Overdetermined Overdetermined | Overdetermined 


5.7.5 GREEN'S FUNCTIONS 


In the following, г = (z,y,z), ro = (£0, Yo, 20), R? = (x — zo)? + (y — yo)? + 


(2 — zo)“, Р? = (x — 20)? + (y — yo)’. 


1. For the potential equation V?G + 526 = —4zó(r — ro), with the radiation 


condition (outgoing waves only), the solution is 


231 eik|2—zo| in one dimension, 


G = 4inHQ (kP) in two dimensions, and (5.7.4) 


eikR 
R 


in three dimensions, 


where HY (-) is a Hankel function (see page 559). 


2. For the n-dimensional diffusion equation 


V’G-a “Се 4nó(r — ro)ô(t — to), (5.7.5) 


дї 


with the initial condition G = 0 fort < to, and the boundary condition G = 0 


at т = oo, the solution is 


477 a И a? |г — 18) 
G = — | —3——— —————— |. 5.7.6 
а? | ge 5) ТАУ ( A(t — to) ы 


VG = —47ô(r — ro)ô(t — to), (5.7.7) 
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with the initial conditions G = G; = 0 fort < tg, and the boundary condition 
G —0atr = оо, the solution is 


2cnH С — to) — аш їп one space dimension, 
5 2 Р . . . 
G= Ито” [(t — to) — =] in two space dimensions, and 
+6 [E — (t — to) in three space dimensions. 
(5.7.8) 
where H (-) is the Heaviside function. 
5.7.6 QUASI-LINEAR EQUATIONS 
Consider the rst-ord er quasi-linear differential equation for u(x) = u(z1,...,xN), 
a41(x,u)us, + as(x,u)us, +: FAN(X, U) = b(X, и). (5.7.9) 
De ning деһ = ак(х, и), for k = 1,2,..., №, the original equation becomes du = 


b(x,u). To solve the original system, the ordinary differential equations for u(s, t) 
and the (x1, (s, t) + must be solved. Their initial conditions can often be parameterized 
as (with t = (t1,...,tN—1)) 


u(s = 0,t) = v(t), 
x1(s = 0, t) = hı(t), 
r2(s = 0,0 = h2(t), (5.7.10) 


zn(5—0,t) = hn(t), 


from which the solution follows. This results in an implicit solution. 


EXAMPLE For the equation u, + 2 ий, = —yu with u = f(y) when x = 0, the 
corresponding equations are 
Ox Oy 2 du 
Os : poc ds 5 
The original initial data can be written parametrically as 2 (= 0,4) 0, y(s 


0,41) = ti, and u(s = 0,t1) = f(ti). Solving for z results in z(s,t1) = s. The 
eguation for y can then be integrated to vield y(s,t1) — a + tı. Finally, the equa- 


: A. : 4 : 
tion for u is integrated to obtain u(s,t1) = f(ti) exp (-5 - sti). These solutions 
constitute an implicit solution of the original system. 

In this case, it is possible to eliminate the s and tı variables analytically to obtain 


3 4 
the explicit solution: u(x, y) = f Č — =) exp e — т). 


5.7.7 SEPARATION ОЕ VARIABLES 


A solution of a linear PDE is attempted in the form u(x) = (21,22,: 5,2 ) = 
Хї(а1)Ха(Фа)--.Х, (ул). Logical reasoning may determine the (X ,+. 
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1. For example, the diffusion or heat equation in a circle is 

Ou 5 18 f ди 1 Bu 

— у 5l + 5.7.11 

улі (а 902 ( ) 

for the unknown u(t, r, 9), where t is time and (r, 0) are polar coordinates. If 
u(t,r, 0) = T(t) R(r)O(0), then 
1d f( dR 1 PO 1ат 
Балақ еее ааа ыш ыу, 5.7.12 
"Бағ (5) + as 4: Td 552 
Logical reasoning leads to 


14Т Г.а? 
а 3 dO d 


_ dR 2 s 
тэгэж 82-7? бар CE) + (-р+тА)Д = 0, 


where A апа р аге unknown constants. Solving these ordinary differential 
eguations vields the general solution, 


u(t,r,0) = f 3 ах f _ dp e^ Е р) sin(,/p0) + C(A, p) соз(у70)| 


х [D p)Jys(VÀr) + EA, руу. (VA) 
(5.7.13) 


Boundary conditions are required to determine the ( B, C, D, E]. 


2. A necessary and sufcient condition for a system with Hamiltonian Н = 
+(р? + P2) + V (2, y), to be separable in elliptic, polar, parabolic, or Cartesian 
coordinates, is that the expression, 


Vyy — Vze)(—2azy — by — ba +d) +2V,y(ay“ — ax? + by – Ух +c—d) 
+ Vz (Gay + 3b) + Vy(—6az — 3b"), (5.7.14) 


vanishes for some constants (a, b, b, с, с, d) # (0,0,0, с, c, 0). 


3. Consider the orthogonal coordinate system {u !, и? ‚иЗ +, with the metric 104), 


and g = 911922933. The Stackel matrix is de ned as 


[Фи (и) $,»(u!) Žislu. | 
S = |Фоу(и?) Ф»»(и?) Фәз(и?) |, (5.7.15) 
| ёи(48) 2) 249) 


where the (Ф;;) are tabulated in different cases. The determinant of S can be 
written as s = Фу M11 + Фәу М + 634 M33, where 


Фо) Bag Фә Фіз Фуз Piz 

Mu = Ma = — My = 

AS Es Фзз|? JA $3; 9з3| 317 [Ba a 
(5.7.16) 
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If the separability conditions, gi; = s/Mj and \/g/s = ћ (и!) (и?) fs (už), 
are met then the Helmholtz equation V?W + A?W = 0 separates with W = 
Xi (ul) X2 (u?) X3 (u?). Here the {X;} are de ned by 


3 
1d 
fi аш (155 аш ) цаг > ajbi — 0, (5.7.17) 
j=l 
with a, = А2, and а» and аҙ arbitrary. 


(a) Necessary and suf cient conditions for the separation of the Laplace 
equation (V“W = 0) are 


% Ма аа Y. pilu!) ROP) (88) Ма. 6.7.18) 


(b) Necessary and suf cient conditions for the separation of the scalar Heml- 
holtz equation are 


Jii = = and уб = fi(u') falu’) fa(u?). (5.7.19) 


EXAMPLE Іп parabolic coordinates Ги, v, Y} the metric coef cients are фт = g22 = 
и? + v? and дзз = pv”. Hence, \/g = ши(и? + 1?). For the Stickel matrix 


и —1 -1/ш 

S— lu 1 -ip (5.7.20) 
0 0 1 

(for which s = р? +v?, Му = Mo; = 1, and M31 = ns + v ?), the separability 


condition holds with f; = u, f» = v, and f3 = 1. Hence, the Helmholtz equation 
separates in parabolic coordinates. The separated equations are 


i d dX; a3 
AA = s | 
= (а ) + 1 (ou? a2 z) = 0, 


1а ах» озу __ 

m (v ) ib (о? d dr: 22) = 0, and (5.7.21) 
d? Хз 

die + аз Хз = 0, 


where W = Ху (ш) Х (и) Хз(). 


5.7.8 SOLUTIONS ОЕ LAPLACE S EQUATION 
1. If V?u = 0 ina circle of radius R and u(R, 9) = f(0), for0 < 0 < 27, then 
u(r, 6) is 


1 27 R? = г? 
utri) 2n 1 R? — 2Rr cos(0 — à) + т? 100) dé. 
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2. If V?u = 0 in a sphere of radius one and u(1,0, 9) = f(0, Ф), then 


Ť T 27 1 r? 
jú: б" yi Ф 
u(r, 8,4) af І FOD тузт Sin © dO dô, 


where cos y = cos 0 cos © + sin $ sin © cos(¢ — Ф). 
3. If V?^u = 0 in the half plane y > 0, and u(a,0) = f(x), then 


шиЕ 28 


TJ s (t-t)? +y? 


4. If V?u = 0 in the half space z > 0, and u(a, y, 0) = f(x,y), then 


С 
мна Гетото т дын 


5.7.9 SOLUTIONS ТО THE WAVE EGUATION 


1. Consider the wave eguation = = V: = Us abo + En, with x = 
(Z1,...,Tn) and the initial data u(0, x) = f(x) and u,(0, x) = g(x). When n 
is odd (and n > 3), the solution is 


1 9 9 (1-8) / Ей 
u(t,x) = milý (25) lf; x, t] 


ә \(n-8)/2 
+ (25) 1 wigs x a} 
tôt 3 , , 


(5.7.22) 


where w[h; x, t] is the average of h(x) over the surface of an n-dimensional 
sphere of radius ¢ centered at x; that is, w[h: x, t] = mae | h(¢) dQ, where 
|¢ —x|? = 8,04 —1(t) is the surface area of the n-dimensional sphere of radius 
t, and dQ is an element of area. 


When n is even, the solution is given by 


1 rer n-1 dp 
ux) = o x x) [raut 
9 (n—2)/2 pt p” 1 dp 

+ (x) [ «0; x, 202511 


(5.7.23) 
where w[h; x, t] is de ned as above. Since this expression is integrated over 


p, the values of f and g must be known everywhere in the interior of the 
n-dimensional sphere. 
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Using un for the solution in n dimensions, the above simplify to 


1 | pes 
м0 = 5106-06015 004600) 6724) 
Жаз == E 
Rit) 
+5 | | ==” ад == + 6) саб, and (5.7.25) 
20 ув-2-2 
us(x,t) = 3 (ntf M + tu[g: x, t], (5.7.26) 


where R(t) is the region ((61, 62) | 2-2 < t°} and 


1 27 т 
wlh;x,t] = ЛЖ | | h(x1 + tsin8 cos ф,со--18Шш Ө sin ф, (5.7.27) 


та +tcos$) x sin 0 dé dý. 


2. The solution of the one-dimensional wave equation 


Vit = С Ugg 
v(0,t) = 0, for 0 < t < оо, (5.7.28) 
v(z, 0) = f(x), for < x < oo, 
vlz, 0) = g(x), for € x < oo, 


het 


Қа) = 2 [f(a + et) + fle — e] + O) dc. for x > ct, 
| 2 [f(x + ct) — f(et — a)] +; 12:10 (¢)d¢, fora < ct. 


(5.7.29) 
3. The solution of the inhomogeneous wave equation 
Ou Ou Ou Ou 
—————————-—F( 5.7.30 
with the initial conditions u(0, x, y, z) = O and u;(0,x,y, z) = 0, is 
ut. 1,4,2) = — z | 2224 m л m$) ас dn dé, (5.7.31) 


pct 


with p = y (x — б)? + (у — m)? + (z — €)2. 
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5.7.10 PARTICULAR SOLUTIONS TO SOME PDES 


In these tables, we assume that P(x) is a polynomial of degree n. 


If R(x) is A particular solution to z, + mzy = R(x, y) is 


ван /(а + mb). 
f f(y) du/(a + mb), u= ax + by. 
«f(y — та). 


evaluate f(y — mz) | ф(х, а + mz) dz; Шеп 


substitute a = y — mz. 


If R(x) is A particular solution to z, + mzy — kz = R(x, у) is 
(5) | eot toy e" Ui / (a + mb — k). 


© | sinfaz + by) араараа b 


(7) | e%*+8Y ѕіп(ал + by) | Replace k by k—a — mf in formula (6) and multiply 
by et tby, 


(8) | ё f (az + by) eke f f(y) du/(a-- mb), u= ах + by. 
(9) | fly — mz) -f(y — mz)/k. 
(10) | P(x) f(y — mz) - f (y—mx) A Pn . 


(11) | e*? f (y — mz) тек f(y — mz). 


5.8 EIGENVALUES 


The eigenvalues {А} of the differential operator L are the solutions of L[u;] = 
Aju;. Given a geometric shape, the eigenvalues of the Dirichlet problem are called 
eigenfrequencies (that is, V?u = Au with u = 0 on the boundary). 


(a) You cannot hear the shape of a drum. The following gur es have the same 
eigenfrequencies. 
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(b) You cannot һеаг the shape of а two-piece band. The following pairs of gur es 
have the same eigenfreguencies. 


У8 
1 E 2 2 у2 2 
1 2 


1 у2 
5.9 INTEGRAL EQUATIONS 
5.9.1 DEFINITIONS 
Кг) 
Ма а) = f(x) + af k(x, t)G[u(t); t] dt. (5.9.1) 

e k(x,t) kernel 

e u(x) function to be determined 

e h(x), f(x), b(z), G[z, t] given functions 

.ЦА eigenvalue 


5.9.1.1 Classi cation of integral eguations 


1. Linear G[u(z); x] = u(x) 
2. Volterra b(a) = 2 

3. Fredholm 5(2) =b 

4. First kind Һа) = 0 

5. Second кіпа Ма) = 1 

6. Third кіпа h(x) Z constant 
7. Homogeneous f(x) = 0 

8. Singular a = —oo, b = oo 


5.9.1.2 Classi cation of kernels 


1. Symmetric k(a,t) = k(t, x) 

2. Hermitian k(z,t) = k(t, x) 

3. Separable/degenerate k(z,t) = X; ai(z)bi(t), n < со 
4. Difference k(z,t) = k(x — t) 

5. Cauchy k(z,t) = тч 

6. Singular k(z,t) > ast — x 

7. Hilbert-Schmidt [> [É Ik(a,t) da dt < oo 
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5.9.2 CONNECTION TO DIFFERENTIAL EQUATIONS 


The initial-value problem 


u (x) + A(z)u'(z) + B(z)u(z) = g(a), x >a, 


и(а) = ci, wu (a) = с, ЭЭЖ 
18 eguivalent to the Volterra integral eguation, 
и(2) = f(a) + | k(z,t)u(t) dt, «>a, 
fla) = [е Hg)at+(e-D[A@atalta, 999 
k(a,t) = (t — x)[B(t) — A'(0)] — А0). 
The boundary-value problem 
u" (z) + A(z)u'(z) + B(z)u(z) = g(a), a<a<b, 
ula) = a, ulb) = о, Qu 
is equivalent to the Fredholm integral equation 
b 
uiv) «f Mud a esi 
т b 
fG) m a | e natae 5 Ё -а-/ 0-0) 4| | 
а [E80 - (0 00400 - BD, т>», 
| boa (At) — @—)[А'@) — Bl), z <1 
(5.9.5) 


5.9.3 FREDHOLM ALTERNATIVE 
Foru(x) = f(x) +A p k(a,t)u(t) dt with A Z 0, consider the solutions to u g(x) = 
df? k(x, tung (t) dt. 


1. If the only solution is u g (£) = 0, then there is a unique solution u(z). 


2. If ug(x) Z 0, then there is no solution unless JE uží(6) f(t) dt = 0 for all 
ил (x) such that uz (2) = afi k(t, 2)и (t) dt. In this case, there are in- 
nitely many solutions. 
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5.9.4 SPECIAL EQUATIONS WITH SOLUTIONS 


1. Generalized Abel eguation: JE boul = f(x) 
Solution is a 
sin(a t 
UE ce 4. D] m (ж) — hl) = (5.9.6) 
where 0 < z < 1,0 <а< 1,0 < A(z) : >? ) > 0, and һа) is 
continuous. 
. ! u(t) 
2. Cauchy equation: uu(z) = f(x) + "e dt 
Т 
Solution is 
шан. (ey) 4. 4 s t VIO: 
u(x) = Ё S CET 2) yd (s PUE dt, H < 0, (5.9.7) 
a- зе) (1-1) £() 
z x ado aor Л, gd dt, p 0, 


where 0 < 2 < 1, p is real, и Æ 0, |u| = r cot(ry), 0 < y < 1/2, and the 
integral is a Cauchy principal value integral. 


3. Volterra equation with difference kernel: u(x x) +A vie k(x—t)u 


Solution is 


u(x) = £71 тл 1 (5.9.8) 


fora > 0, £[f(x)] = F(s) and £ [k(x)] = K(s). 
4. Singular equation with difference kernel: u(x x)+r L k(x—t)u 


Solution is 

| еви) 
мт J- 1 — АК (a) 

where —oo < z < oo, F(a) = F [f(x)], and Ka) = F [k(z)]. 


u(x) da (5.9.9) 


5. Fredholm equation with separable kernel: 


b n 
и(2) = f(a) +A Э aj (x)b, (t)u(t) dt 


& k—1 
Solution is " 
u(x) = f(x) + майа) (5.9.10) 
21238477 оваа | эы 2)а, (0) dt where a € x < b, 


n « oo, and m — 1,2,...,n. 
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6. Fredholm equation with symmetric kernel: u(x) = Р(х) КА | К(2,0)и(0) dt 


ухаа? 


Solve un (2) = An Ї k(x, t)us (t) dt for (un. An}n=1,2,.... Then 


oo us b u d 
(a) For A Z Ал, solution is u(x) = f(x) +X 2 m 


(b) For A = A, and ой f(t)un(t = = 0 for all Ч solutions аге 


кн 


for m — 1,2,... 


where a € z < b, and k(z,t) = k(t, 2) (see Section 5.9.3). 


7. Volterra equation of second kind: u(x J+A ik k(a, thu 
Solution is 
)+ os 5 X ks ca (x, t) f (t) dt, (5.9.11) 
а n=0 
where kı (x,t) = k(z,t), kn4i(a,t) = fk (5,1) ds, when k(z, t) 


and f(a) are continuous, A Z 0, and x > a. 


8. Fredholm equation of second kind: resolvent kernel 


b 
x) +f (е, иб) dt (5.9.12) 
Solution is : 
u(x) = Қа) ef DO) dt, (5.9.13) 


where 


Co — 1, ү An —1(t,1)dt, n=1,2,..., (5.9.14) 
(sides) алыг 
ИЙ - т — 40 т 


Ao(z,t) = k(z,t) 
b 
An(z, t) = са k(z, t) — nf k(a, s) An —1(5,t) ds 


where k(x,t) and f(a) are continuous, A Z 0, a < x < b, and D(A) #0. 
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9. Fredholm eguation of second kind: Neumann series 


b 
ús ef (2, иб) dt (5.9.15) 
Solution 1s 2 
u(x) = f(a) + 5 A" bn(2), (5.9.16) 
n=1 


where 


b 
dics f maj oja. 
ka (z, s) = k(a, s), (5.9.17) 


b 
ШАРЫ ОУ, = | MaDe бей, NEDA oh, 


EN —1/2 
where |A| « (Т Jik (x,t) dz dt) „AZ. anda € z <b. 


5.10 TENSOR ANALYSIS 


5.10.1 DEFINITIONS 


1. An n-dimensional coordinate manifold of class C*, k > 1, is a point set M 
together with the totality of allowable coordinate systems on M. An allowable 
coordinate system (©, U) on M is a one-to-one mapping © : U > M, where U 
is an open subset of IR". The n-tuple (r!,..., x") Є U give the coordinates of 
the corresponding point d(1!,..., x") € M. If ($, U) is a second coordinate 
system on M, then the one-to-one correspondence à оф: > U, called 
a coordinate transformation on M, is assumed to be of class C^. It may be 


written as 2 5% 

q cf сазы ї=1,...,п, (5.10.1) 
where the f аге de ned by (67! о9)(21,...,27) = (fi(z!,...,2"),..., 
f"(a!,..., x")). The coordinate transformation $^! o ¢ has inverse $^! од, 


expressible in terms of the coordinates as 


r = iom). i=1,...,N. (5.10.2) 


2. In the Einstein summation convention a repeated upper and lower index signi- 
es summation over the range k = 1,...,n. 
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01“ 


Я 4 . й ді k 5 
3. The Jacobian matrix of the transformation, 577, satis es 94 92. = ô; and 


227 Dr = бі, where 6! — { Т à 2; denotes the Kronecker delta. Note 
also that det (25) Z 0. 


4. A function F : M — Ris called a scalar invariant on M. The coordinate rep- 
resentation of F in any coordinate system (0, U) is de ned by f :— Fog. The 
coordinate representations f of F with respect to a second coordinate system 
(ф, Ü) is related to f by f(#',...,@") = f(f!(8,...,8^),..., f^(&,..., 

5. A parameterized curve on M is a mapping y : I > M, where I C R is some 
interval. The coordinate representation of y in any coordinate system (Фф, U) 
is a mapping g : I — R” de ned by g = $^! о y. The mapping g de nes a 
parameterized curve in IR". The component functions of g denoted by g (for 
i = 1,...,n) are de ned by g(t) = (g! (t), <- , g^(t)). The curve y is C* if, 
and only if, the functions g^ are C* for every coordinate system on M. The 
coordinate representation g of y with respect to a second coordinate system 
(ф, à) is related to g by Ji (t) = f*(g! (t), --- ,g^(t)). 


6. A mixed tensor T of contravariant valence r, covariant valence s, and weight 
w at p € M, called a tensor of type (r, s, w), is an object which, with respect 
to each coordinate system on M, is represented by n" *? real numbers whose 
values in any two coordinate systems, ф and ф, are related by 


— ше (35) ү ks Oz" дї‘ 0x“ 0x5. 


д21 6 Өте дт Oči Og 
ees keene’ 


r factors s factors 
(5. 


cand TEES 
Т 215552» 


10.3) 
The superscripts are called contravariant indices and the subscripts covariant 
indices. If w Æ 0, then Т is said to be a relative tensor. If w = 0, then 
T is said to be an absolute tensor or a tensor of type (r,s). In the sequel 
only absolute tensors, which will be called tensors, will be considered unless 
otherwise indicated. A tensor field Т of type (т, s) is an assignment of a tensor 
of type (r,s) to each point of M. A tensor eld T is C'* if its component 
functions are C for every coordinate system on M. 


5.10.2 ALGEBRAIC TENSOR OPERATIONS 
1. Addition: The components of the sum of the tensors Tı and T» of type (7, s) 
are given by 


queue = [йн „Ше (5.10.4) 


71:48 ШЕР As 


2. Multiplication: The components of the tensor or outer product of a tensor Т 
of type (r, s) and a tensor Т» of type (t, и) are given by 


diede ky ky bd ds kid 
Т, ы cq “ыда”, емір (5.10.5) 
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3. Contraction: The components of the contraction of ће t contravariant index 
with the u“ covariant index of a tensor T of type (r, s), with rs Z 0, are given 
dida Rita ds 

by T jiju-ikjuqitjs] 

4. Permutation of indices: Let Т be any tensor of type (0, r) and 5, the group 
of permutations of the set {1,--- ,r). The components of the tensor obtained 
by permuting the indices of Т with any c € Sp, are given by (oT )4,..;, = 
Ti, i, The symmetric part of T, denoted by S(T), is the tensor whose 
components are given by 


1 
S(T)i...i, — Тас — т! 5 уйу; (5.10.6) 
"008, 
The tensor T is said to be symmetric if, and only if, 74.42, = T(j,..;,). The 
skew symmetric part of Т, denoted by A(T), is the tensor whose components 
are given by 


1 
Ai = Тн] = J Узр) Ti aiso (5.10.7) 
“0665, 


where sgn(c) = +1 according to whether c is an even or odd permutation. 
The tensor Т is said to be skew symmetric if, and only if, Т... = T[i,...i,]. 


Ifr = 2, SÚP paši = (Ти af Tisi) and ЖОҒЫ = (Ти = TJ: 


5.10.3 DIFFERENTIATION OF TENSORS 


]. In tensor analysis a comma is used to denote partial differentiation and a 
semicolon to denote covariant differentiation. For example, А); ;,;, denotes 


дА) 1/01. 


2. A linear connection V at p € M is an object which, with respect to each 
coordinate system on M, is represented by n? real numbers Г? ук» called the 


connection coefficients, whose values in any two coordinate systems ф and ф 
аге related by 


4, dn Ont да" д?х* дї! 

тт Ort 03) Oz" 021928 Әдеб 
The guantities Г? jk are not the components of a tensor of type (1, 2). A linear 
connection V on M is an assignment of a linear connection to each point of 


M. A connection V is C if its connection coef cien ts Г", g are C+ in every 
coordinate system on M. 


Гэсэр (5.10.8) 


3. The components of the covariant derivative of a tensor eld Т of type (r, s), 
with respect to a connection V, are given by 


lions Non ЕЕ КО эт 

Қап” a = OREO ЕТ ары ы (5.10.9) 
ir A O ГА did, 2 413446 

жа uet? jon Enk A Тар ТП T seti 
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where 


or 


pT ын ds =T% n dek T = (5.10.10) 


This formula has this structure: 


(a) Apart from the partial derivative term, there is a negative af ne term for 
each covariant index and a positive afne term for each contravariant 
index. 


(b) The second subscript in the T-symbols is always the differentiated index 
(k in this case). 


4. Let Y“(t) be a contravariant vector eld апа Z,(£) a covariant vector eld 
de ne d along a parameterized curve y. The absolute covariant derivatives of 
Y and Z; are de ned as follows: 


бүй  dY! 02202 
Ний b r 
Н (5.10.11) 
62, (42: ру р dr 
ót dt ik Ai E 


where z“ denotes the components of y in the coordinate system ф. This deriva- 
tive may also be de ned for tensor elds of type (r,s) de ned along y. The 
derivative has the same structure as Equation (5.10.9). 


5. A vector eld Y“(t) is said to be parallel along a parameterized curve у if 

ЗҮ! 

Sr =0. 

6. A parameterized curve у in M is said to be an affinely parameterized geodesic 
if the component functions of » satisfy 


dt dt — 


ô (da! gu ; ахі dr" 
al je ag t ета 


which is equivalent to the statement that the tangent vector de. to y is parallel 
along y. 


7. The components of the torsion tensor 5 of V on M are de ne d by 
бк = Гк Гу. (5.10.12) 
8. The components of the curvature tensor R of V on M are de ned by 
R’ ipe = OT — Гь +E T me — ne (5.10.13) 


In some references R is de ned with the opposite sign. 


9. The Ricci tensor of V is de ned by Р; = Rong 
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5.10.4 METRIC TENSOR 


1. A covariant metric tensor field on M is a tensor eld gj; which satis es 
Jij = gji and g = det(g;;) # 0 on M. The contravariant metric g“) sat- 
ises g^ gkj = бї. The line element is expressible in terms of the metric 
tensor as ds” = gj; ШЕ Я 


2. Signature of the metric: For each р € M, a coordinate system exists such that 

gij(p) = diag (1,..-,1,-1,...,-1). The signature of gij is de ned to be 
Бат с. —— 
n—r 

s — 2r — n. Itis independent of the coordinate system in which g, (p) has the 
above diagonal form and is the same at every p € M. A metric is said to be 
positive definite if s — n. 
A manifold admitting a positive de nite metric is called a Riemannian man- 
ifold. A metric is said to be indefinite if s ZZ +n. A manifold, admitting an 
inde n ite metric is called a pseudo-Riemannian manifold. If s = +(n — 2) 
the metric is said to be Lorentzian and the corresponding manifold is called a 
Lorentzian manifold. 


3. The inner product of a pair of vectors X? and У? is given by g;; X'Y?. If 
X’ = Y’, then б, X' X? de nes the “square” of the length of X“. If gj; is 
positive de nite, then g;; X! XJ > 0 for all X“, and д) X! X7 = 0 if, and 
only if, X = 0. In the positive de nite case, the angle 0 between two tangent 
vectors X and Y is de ned by cos@ = 9 XYI (ды XX АҮ ^Y )8. 
If g is inde nite, g;;X Хі may have a positive, negative, or zero value. A 
non-zero vector X“, satisfying 0%) X X? = 0, is called a null vector. If gi; is 
inde n ite, it is not possible in general to de ne the angle between two tangent 
vectors. 


4. Operation of lowering indices: The components of the tensor resulting from 
lowering the t" contravariant index of a tensor T of type (r,s), with r > 1, 
are given by 

diede араб 2 dida араг. 
T й Т СТ даһТ jvejs (5.10.14) 

5. Operation of raising indices: 'The components of the tensor resulting from 
raising the t" covariant index of a tensor T of type (r,s), with s > 1, are 
given by 


41: jt — АЖЕТ 
Т pt id pipin ja =g T 


(5.10.15) 


A. Ji-ikjgicejs] 


6. The arc length of a parameterized curve y : I > M, where I = [a,b], and à 
is any coordinate system, is de ne d by 


b 
ps | cig De (Dna dl: (5.10.16) 
a 
where є = sgn(gi;@°@) = +1 and 27 ae. 


© 2003 by CRC Press LLC 


5.10.5 RESULTS 


The following results hold оп any manifold M admitting any connection V: 


1. The covariant derivative operator V , is linear with respect to tensor addition, 
satis es the product rule with respect to tensor multiplication, and commutes 
with contractions of tensors. 


2. If T is any tensor of type (0, r), then 


1 
Уан = Tig sink] = 5 (27517272 ++ Васи) 2 
(5.10.17) 
where | | indicates that the enclosed indices are excluded from the symmetriza- 
tion. Thus Tj;,...;,,4) de nes a tensor of type (0,r + 1), and Vi,T;,...;,j = 
Tli, ...i,,] in the torsion free case. If T; = V jf = Ј ;, where f is any scalar in- 
variant, then Vr; V jj f = 258%. In the torsion free case, У,У,/ = V;Vif. 


3. If X? is any contravariant vector eld on M, then the identity 2V ТИРА + 
УХ = X‘R',,,, called the Ricci identity, reduces to 2V УЫ X^ = 
R', j к^ біп the torsion free case. If Y; is any covariant vector eld, the Ricci 
identity has the form 2V Улук У/Ұ, 5%; = VYR The Ricci identity 
may be extended to tensor elds of type (r, s). For the tensor eld Т%,, it has 
the form 

ЗУ УТ uu Val pao = ЛЫН" 


nij —. 


If g is any metric tensor eld, the above identity implies that 
Rajke = Vi V ggij — $V mij Sky 


4. The torsion tensor S and curvature tensor R satisfy the following identities: 


S jk) = 0, 0 = Кет m R’ injik S tmp (5.10.19) 
ШИ; — 0, ka) = —5 [уу] + SmS kt]: (5.10.20) 


In the torsion free case, these identities reduce to the cyclical identity R jké] = 
0 and Bianchi s identity В? ikem] = 0. 


The following results hold for any pseudo-Riemannian manifold М with a met- 
ric tensor eld gi;: 


1. A unique connection V called the Levi-Civita or pseudo-Riemannian connec- 
tion with vanishing torsion (5% = 0) exists that вай ев Vigj, = 0. It 
follows that V;g/* = 0. Christoffel symbols of the first kind. The connec- 
tion coef cien ts of V, called the Christoffel symbols of the second kind, are 
given by I’, = 4408,6, where 75,0 = (030, + океј — дук) are the 

es 1 у s 
Ге, = 20 (log g) = |g| 20;|g|? and бууд = [ki, j] + [k7. i]. 
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2. The operations of raising and lowering indices commute with the covariant 
derivative. For example if X; = gi; XÍ, then V, X, = gij VxXÍ. 


3. The divergence of a vector X? is given by V; X! = |g| 3 0;(|g|2 X). 
4. The Laplacian of a scalar invariant f is given by 
5 г. 1 1.22 

Af = g? ViVi f = Vi(g? Vif) = 1917290191299). 

5. The equations of an af nely parameterized geodesic may be written as 
(gist?) — 20,20 à = 0. 

6. Let X? and Y be the components of any vector elds which are propagated 
in parallel along any parameterized curve y. Then 4 (gij X iYi) = 0, which 


implies that the inner product g;; X ^Y 7 is constant along y. In particular, if 2* 
are the components of the tangent vector to y, then g ;;2° 27 is constant along y. 


7. The Riemann tensor, de ned by Rijke = бҥт, is given by 
Ниш = [j4, i]; —[jk, i], +[i£, m)r"j, — lik, m)r5, 
1 
— 3 itk + 936,40 — 930,46 — 98650) (5.10.21) 
+g" ((il, m][jk,n] — |, т], т). 

It has the following symmetries: 

Rijo Балы-0, Rijke = Bag, and Rijk = 0. (5.10.22) 
Consequently it has a maximum of n? (n? — 1) /12 independent components. 


8. The equations Rijķe = 0 are necessary and suf cient conditions for M to be 
a flat pseudo-Riemannian manifold, that is, a manifold for which a coordinate 
system exists so that the components g;; are constant on M. 


9. The Ricci tensor is given by 
Rij 20,7%, — AT“, T r“. — ГЕ; T^, 
1 1 
= 209; (log |g|) — z yâr (log 19) = OT“, + DAD 
It possesses the symmetry Ё;; = Ri, and thus has a maximum of n(n + 1)/2 
independent components. 
10. The scalar curvature or curvature invariant is de ned by R = g Rx. 
11. The Einstein tensor is de ned by Gij = Rij — 5913. In view of the Bianchi 
identity, it satis ев: g^ V ;G,; = 0. 
0 : 
12. A normal coordinate system with origin хоєМ is de ned by Jij 27 --0,/47, 
where a “0” af x ed over a quantity indicates that the quantity is evaluated 
0 


at то. The connection coef cients satisfy али = 0 (forr = 2,3,...) 
in any normal coordinate system. The equations of the geodesics through хо 
are given by т” = sk“, where s is an af ne parameter and k“ is any constant 
vector. 
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5.10.6 EXAMPLES OF TENSORS 


1. The components of the gradient of a scalar invariant 21. de ne a tensor of 


type (0,1), since they transform as AL = zL 


2. The components of the tangent vector to a parameterized curve d Че пе a 
tensor of type (1,0), because they transform as ак = de gee 


3. The determinant of the metric tensor g de nes a relative scalar invariant of 


. 12 
да” 
927 


weight of w = 2, because it transforms as 0 = | g. 


4. The Kronecker deltas 6! are the components of a constant absolute tensor of 
type (1, 1), because бі = óf 3% да” 


4 Әле 9227 


5. Тһе permutation symbol de ned by 


1, if 11 ++ in is an even permutation of 1---n, 
irin 24 —1, 1f11: +12, is an odd permutation of 1: · n, and 
0 otherwise, 

(5.10.23) 
satis es А Өңеш = Oda дат 32 oa . Hence it de ne s a tensor of type 
(0, n, —1), that is, it is a relative tensor of weight ш = —1. The contravariant 
permutation symbol ес, de ned in a similar way, is a relative tensor of 
weight ш = 1. 

6. Тһе Levi-Civita symbol, €;,...;, = |4|264,..2,, de nes a covariant absolute 


tensor of valence n. The contravariant Levi-Civita tensor satis es 


n—s 


єй” m ghi isi ginda ejj, = (—1) 5 [gl žel vi. (5.1024) 


Using this symbol, the dual of a covariant skew-symmetric tensor of valence 
1 11517» 


т is de ned by “Та, 55516. “до, 24719036 

7. Cartesian tensors: Let М = E? (.e., Euclidean three-space) with metric 
tensor gi; = 6;; with respect to Cartesian coordinates. The components of a 
Cartesian tensor of valence r transform as 


Tig susie = Т O с Ош» (5.10.25) 


where Oj; are the components of a constant orthogonal matrix which satis es 
(075); = (0); = Оу. For Cartesian tensors, all indices are written as co- 
variant, because no distinction is required between covariant and contravariant 
indices. 


An oriented Cartesian tensor is a Cartesian tensor where the orthogonal ma- 
trix in the transformation law is restricted by det(O;;) = 1. The Levi-Civita 
symbol є; зк is an example of an oriented Cartesian tensor as is the cross prod- 
uct, (X x Y); = єє X; Yp, of two vectors. The connection coef cients satisfy 
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гі jk = О іп every Cartesian coordinate system on ЕЗ. Thus the partial deriva- 
tives of Cartesian tensors are themselves Cartesian tensors, that is, if T';,...;, 
is a Cartesian tensor, then so is Ot T;,...;,. A particular example is the curl of 
a vector eld X, given by (curl X), = €;;,0;X, which de nes an oriented 
Cartesian tensor. 


8. Note the useful relations: €;;,€%1m = дибут — ÓimÓjl, Cikl€kim = 20im, and 
€ijkClmn = дуд jmOkn =k dimOjn Ok + din Ôj1Ôkm = din ÔjmôÔkl = бид детп = 
бадуадкт. 


9. The stress tensor Ej, and the strain tensor еҙ; are examples of Cartesian ten- 
sors. 


10. Orthogonal curvilinear coordinates: Let M be a 3-dimensional Riemannian 
manifold admitting a coordinate system [x ! , z? , 23) such that the metric tensor 
has the form gi; = h?(a',2?, 2°) fori = 1,...,3 with gi; = g = 0 for 
i Æ j. The metric tensor on E? has this form with respect to orthogonal 
curvilinear coordinates. The non-zero components of various corresponding 
quantities corresponding to this metric are as follows: 


(a) Covariant metric tensor 
= 2 = 2 52 2 
gu = №, 922 = №”, 933 = Рз (5.10.26) 
(b) Contravariant metric tensor 
g'-h^?, g"-hy?,  g =h? (5.10.27) 


(c) Christoffel symbols of the rst kind (note that [ij, k] = 0 if i, j, and k 
are all different), 


[11,1] 2 hia [11,2] = 41» [11,3] = —hhis 
[12,1] = hh » [12,2] = Ash» [13,1] = hihi 
[13,3] = Asha, [22,1] = —hahai | [22,2] = haha» 
[22,3] = —hz2h23 [23,2] = haha. [23,3] = haha. 
[33,1] = —haha; [83,2] = —hahsa [33,3] = haha s. 


(d) Christoffel symbols of the second kind (note that Г k = 0 if i, j, and k 
are all different), 


dl hri Tta = hy шиг? [uu sh ni 
Ёзге —h hoho, [ou = ? haha pore —hiha ? hi» 
Dd he T = һә d T3 = һә his 
T3 = —h2°hshs2 Ta Unas L5. Ay 
p Арла Виз. Pb hag pu ehe 
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(е) Vanishing Riemann tensor conditions (Lamé eguations), 


ha ,2,3 = Бог hi 2ħ2,3 — ha ін һа = 0, 

ha 1,3 = haha 3h21 — ha | haha = 0, 

ha,2 — hy hi 2h31 = һә” ha has =0, 

haha 3,3 + haha,» + hi hahaha ha ыг h3 hsh 2h32 
— haha ha 3h33 = 0, 

hy hn 3,3 + haha + hi ha ^ hah 2ħ3,2 = ha halu aha 
- hıh hi 3h33 = 0, 

hy hn 2,2 + haha + hi haha ^ hi aha, B hi hahaha 
— hiha лэ! 2-0. 


11. The 2-sphere: A coordinate system (0, 6] for the 2-sphere x? + y? + 2? = т? is 
given by 2 = "віпбсовф, y = r sin ĝ sin ф, 2 = т соз Ө, where [0, 9] € U = 
(0,7) x (0,27). This is a non-Euclidean space. The non-zero independent 
components of various quantities de ned on the sphere are given below: 


(a) Covariant metric tensor components аге g11 = r“, 492 = т? sin? 9. 
(b) Contravariant metric tensor components are g)! = r7?, g?? = r7? esc? Ө. 


(c) Christoffel symbols of the rst kind аге [12,2] = r? sin Ө cos 6, 
[22,1] = —r? sin 9 cos. 

(d) Christoffel symbols of the second kind аге ГІ, = — sin 0 cos 6, 
Г?» = —cos@cscé. 

(е) Covariant Riemann tensor components are R1212 = т? sin“ 9. 

(f) Covariant Ricci tensor components are R11 = —1, Ra = — sin“ 9. 


(g) Ricci scalar is R = —2r7?. 


12. The 3-sphere: A coordinate system [y, 0, ф| for the 3-sphere x? + y? + 2? + 


ш? = т? is given by r = rsiný sin$ coso, у = rsinvsinÜsinó, z = 


rsinw cos Ө, and w = r cosh, where |0,0,ф| € U = (0, т) x (0, т) x (0,27). 
The non-zero components of various quantities de ned on the sphere are given 
below: 


(a) Covariant metric tensor components 
дает”, goo = т? sin? V, 933 = т? sin“ Ysin? 6 (5.10.28) 
(b) Contravariant metric tensor components 


g! =r7?, g? =r? esc? y, g = т? све? v сөс? 0 
(5.10.29) 
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(c) Christoffel symbols of the rst kind, 


[22,1] = —r? sin Y cos [33,1] = —r? sin сов sin? 0 
[12,2] = r? sin cos [33,2] = —r? sin? y sin 0 cos 0 
[13,3] =r? sin cos sin“ @ [23,3] = r° sin? v sin 8 сов0. 


(d) Christoffel symbols of the second kind, 


T5, = — sin b cos T5, = — sin соѕ sin“ 0 
Г?» = cot sj Г2,5 = — sin cos 
I, = cot sj T3 = соб. 


(е) Covariant Riemann tensor components, 

Ri212 = т? sin“ v, Ё1з1з = т? sin“ v sin“ 0, R2323 = т? sin“ v sin“ 0. 
(f) Covariant Ricci tensor components, 

Ву = —2, Rog =—2sin?y, R33 = —2sin? y sin“ 9. 
(g) The Ricci scalar is R = —6r7?. 


(h) Covariant Einstein tensor components 


Өңд; Соз = sin? y, G33 = sin“ ysin? ð (5.10.30) 


13. Polar coordinates: The line element is given by ds? = dr? + r?d6. Thus the 

1 0 
0 r? 
[21,2] = [12,2] = —[22, 1] = r. 


metric tensor is gj; = , and the non-zero Christoffel symbols are 


5.11 ORTHOGONAL COORDINATE SYSTEMS 


In an orthogonal coordinate system, let {a;} denote the unit vectors in each of the 
three coordinate directions, and let (u;] denote distance along each of these axes. 
The coordinate system may be designated by the metric coefficients {д 11, 922, 933}; 


de ned b 
ад : 0x1 2 Әт» 2 дхз 2 
ii = 2 11.1 


where {21, £2, £3 } represent rectangular coordinates. Then de пе g = 011422033. 

Operations for orthogonal coordinate systems are sometimes written in terms 
of the (^;) functions, instead of the (0) functions. Here, hi = ү/0и, so that 
J/g = № Һәһз. For example, in cylindrical coordinates, {х1 rcos0, x = т sin, 
x3 = z} with {ш = r, ug = 0, из = 2}, we nd {ді = 1, go» = r°, g33 = 1} so 
that {hi 1, һә т, ha 11. 
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In the following, © represents a scalar, and E = Ejaj + Еа + Езаз and 
F = Fia; + Баз + Езаз represent vectors. 


grado = Уф = the gradient of ф 
2 90 ә WA QUE c ш 200 (5.11.2) 


Е м 911 ди v 922 ди» v 933 диз’ 
div E = V - E = the divergence of E 


1 д eh) д (23) д (=)} 
uc L (4) л л 02212284 ues ЕСІ 
52 диз X дээ диз | 933 ) 


curl E = V x E = the curl of E 


ГІ Г» Га 
-— im +а (5.11.4) 
PUn 2 gn 9 47033 
ai a2 a3 | 
hsha hı hg hiha 
_| 8 9 2 
~ | дш дмә диз |? зас 
ҺЕ, ҺЕ» ҺзЕз 
3 
FOE; Е; („д nôh 
(F: V)E]; =>; Е Du hale ( 7 ди | цаа 


4-1 


V? = the Laplacian of ф (sometimes written as Ad) 
1 { 9 ESAE д E д (шы 521) 


Ea Em hy ди ди» һә диә ha диз 


еше EE) on 


У дш 911 дш ди» 922 Ou» диз 933 диз 


Е 21 OY аҳ OY аз OY 
ddiv E = -E)= Z pains oa So 
ere vv =e) м1 дад Ы 1/02 Әлә ү/933 Олз” 


(5.11.8) 


curlcurlE = V x (V x E) 
: g (|даә Ox3 А 9 1923 да (5.11.9) 
[933 | OY. дг; 
таз 0 [5 Әл» |” 
XXE = grad div E — curl curl E = the vector Laplacian of E 
=V(V-E)-V x(V xE) 


: ( 1 OY i 1911 НЫ xi 
== 1 —— — | — — — 
vgn дт G ORS „002 (5.11.10) 
{ 1 OY 922 B x | 
+ a» = $f SS | SS с 
VIz Өте V g lôm да» 
1 OY 933 НЫ d | 
+039 — Tal Tan RE А 
3 { \/ 033 дез 4 Әт» 8x1 
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where Т and Г = (T4, T», Гз) are de ned by 


t= да Pas] а Pan | * s Pas] 

г = S Drs E) — ру- V. 

г, = 85 LV) — go (IE). (5.11.11) 
г, = (ув) - gos m | 


5.11.1 TABLE OF ORTHOGONAL COORDINATE SYSTEMS 


The {fi} listed below are the separated components of the Laplace or Helmholtz 
equations (see (5.7.18) and (5.7.19)). See Moon and Spencer for details. 

The corresponding equations for the four separable coordinate systems which 
exist in two dimensions may be obtained from the coordinate systems 1—4 listed 
below by suppressing the z coordinate and assuming that all functions depend only 
on the x and y coordinates. 


1. Rectangular coordinates fr, y, 2} 
Ranges: -со < 7 < оо, 00 < y < ©, —0 < Z < 00. 


91 = 922 = 933 = V9— 1, 


In this coordinate system the following notation is sometimes used: 
i =а,,ј = ay, k —a,. 


д] д] 21 
grad f = asa +a ET 


. д g 
divE = 5-(E,) + EPIS y) + 5; E z) 


ДЕ, 
ni Ж 


" QE, дЕ, 
а, E ду 


Op Op Pf 

2 = —— 

ua coi Em (5.11.12) 
222 хаг ДЕ, 


2. Circular cylindrical coordinates (r, 0, z} 
Relations: x = r cos 0, y = r sin, z = 2. 


Ranges: 0 < r < œ, 0 < 0 < 2r, —0 < Z < oo. 
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gu = 1, 922 = 17,933 = 1, yJ =r, 
fi Zr, fa — fg — 1. 


grad f a t + 4 a DT 
КЕ 10E, ДЕ, 
divE A r) EN + Əz 
cnie ЛЕ 
т 20 Oz 
DE. ab. (5.11.13) 
(curl E), = 3z — Эг 
J| 10(rEg) 10E, 
шоо оешу 
ТЕР С OfV LO Sf 
m "or NO Өр Т б? 


3. Elliptic cylindrical coordinates {7, ,z1 
Relations: r = a cosh ņ cos Y, y = а зіп sin v, z = z. 
Ranges: 0 < n < оо, 0 €  « 2r, —oo < Z < oo. 
911 = 92 = a? (cosh? n — cos? b), g33 = 1, „Ja = a? (cosh? n — cos? q/), 
drea. 


4. Parabolic cylindrical coordinates 1/1, v, 2) 
Relations: z — 5062 —v"), у = ри, z = z. 
Ranges: 0 < и < oo, —0 < V < 27, TO < Z < oo. 
gii = 923 = + V?, gas =1, /g = р? +1, 
h=h=f=1. 


5. Spherical coordinates {r, 0, % } 
Relations: 2 = rsin@cos¢, у = rsin$ sin ф, z = rcosé. 
Ranges: 0 < r < со,0<0<т,0 € v < 2m. 


911 = 1, goo = r°, g33 = т? sin“ 9, /9 = r? біп Ө, 
fi = r, f = sin 6, fs eI 
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adr op Б sp Ж, 


ðr ` r 08" rsind Od 
div E = 2002, + — 7 ICs sin) + EXE 
(curl E), — шэг ГМ sin 9) — 22 (5.11.14) 
v ту й a) цас 057 09 (s 627) + Ta 


6. Prolate spheroidal coordinates (1,0, 01 
Relations: x = a sinh ņ sin 0 cosy, y = a sinh y sin 0 sin Y, z = a cosh у cos 0. 
Ranges: 0 < у < оо, 0 € 0 € 7,0 € y < 2m. 


dii = 922 = a? (sinh? р + sin? 0) g33 = a? sinh? т] sin? 0, 
Vg = à? (sinh? n + sin? 0) sinh 1] sin 9. 


fi = sinh 1, fo = sin6, fg = а. 


7. Oblate spheroidal coordinates (1,0,1 
Relations: r = a cosh ņ 8110 cos Y, y = a cosh sin 0 8111), 2 = a sinh r cos 8. 
Ranges: O < 7 < оо,0 €0 € 7,0 € v < 2л. 


gii = go» = а? (cosh? n — sin? 0) g33 = a? cosh” n sin? 9, 
Vg = a? (cosh? n — sin? 0) cosh sin Ө. 


fi = coshn, fo = sind, f3 = а. 


8. Parabolic coordinates Ги, v, Y} 
Relations: ж = uv cosy), у = py sin b, z = (и? — v?). 
Ranges: 0 < y< оо, 0 <v < оо, 0 € v < 2m. 
gii = 922 = и? + V? 033 = povo, /g = pl + 1). 
fi —1, fa —v, [3 —1. 


9. Conical coordinates fr, Ө, А) 
Relations: 22 = (r0A/bc)?, y? = т2(02 — b?)(b? — А2) /[b? (2 — bž)], 22 = 
pe — ye — ye — 02). 


Range: 0 < r < oo, b? < 9? < 2.0 < M < 2. 
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gu =l, g2 =r 2(0° — оз EC UA 6*). 
9зз = 7° (6 — X) / (0? XX Ху, 
м9 = т?(0° — ^?)/,/(@? шин 02)(0° 0 abo. 


fi=r’, fa = (8 — b?)(c2 — 82), fa = J (4? — А2) (2 — 22). 


10. Ellipsoidal coordinates (7,0, M 
Relations: x? = (neX/be)?, y? = (i? — b?) (6? — b?) (b? — M) /[b? (с? — Ь?)], 
2? = (9? Pe i-e — әуеде — oy. 
Ranges: c < 2 < oo, b? < 0? < 2.0 < А <b. 


em 008, — ХЭ/((007 Б) (т a 
= (02 — А?) (2 — 0?) /((0? – 0°) (с? 9^». 
esci шиг z2 EE X), 
OE OT а 
22 (085525 О ыы 


11. Paraboloidal coordinates { u, v, A+ 
Relations: ж? = 4(u — b)(b — v)(b — X)/(b — с), 
y? = 4(и — с)(с— и) (А – с)/(Ь— c), 2 = H+v+A-b— c. 
Ranges: b < p< оо, O< v<c,c <A < 6. 


gui = (и—)(и—А)/((и—&)(и—є)), дээ = (u-v)(A—v)/((b—v)(e—v)), 


gss = Qv) (ui) (0-3). Vi ү авла 


p —o)(u — c), fa = (b —v)(c—v), fa = — А)(А — c). 


5.12 CONTROL THEORY 


Let x be a state vector, let y be an observation vector, and let u be the control. The 
vectors X, y, and u have n, m, and p components, respectively. If a system evolves 
as: 


X — Ax + Bu 


жое (5.12.1) 


then, taking Laplace transforms, ý = G(s)ú where G(s) is the transfer function 
given by G(s) = C(sI — A)! B + D. 

A system is said to be controllable if and only if for any times (to, tı + and any 
states (xo, X1 } there exists a control u(t) such that x(to) = xo and x(t1) = хі. The 
system is controllable if and only if 


rank[B AB АВ ... А"-1В|-т, (5.12.2) 
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If, given u(t) and y(t) on some interval tg < t < tı, the value of x(t) can be 
deduced on that interval, then the system is said to be observable. Observability 1s 
eguivalent to the condition 


rank [CT ATCT ... Ae =n. (5.12.3) 


If the control is bounded above and below (say u: < uj < ау), then a bang— 
bang control is one for which u; = u, or u, = uj: (That is, for every t, either 
uj(t) = u7 (t) or u;(t) = uj (t); switches are possible.) A bang—off-bang control is 
one for which u, = 0, u; = и; , oru; = uj. 

A second frequently studied control problem is x = f(x, u, t), where x(fo) and 
x(ty) are speci ed, and there is a cost function, J = d ф(х, u,t). The goal is to 
minimize the cost function. De ning the Hamiltonian H(x,z,u,t) = ф + z - f, ће 
optimal control (the one that minimizes the cost function) satis es 


ОН ,__9H , ӘН 
02 78x ^ Ou’ 


EXAMPLE In the one-dimensional case, with z = —az + u, z(0) = хо, z(oo) = 0, 
and J = fY (x? + u?) dt; the optimal control is given by u = (a — V1 + a?)z" (t) 
where (4) = zoe V !**^t, 
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Functions of negative arguments 

Relationship to inverse hyperbolic functions 

Sum and difference of two inverse circular functions 


CEILING AND FLOOR FUNCTIONS 


EXPONENTIAL FUNCTION 
6.5.1 Exponentiation 
6.5.2 Definition of e? 


6.5.3 


Derivative and integral of ез 
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6.6 LOGARITHMIC FUNCTIONS 


6.6.1 
6.6.2 
6.6.3 
6.6.4 
6.6.5 
6.6.6 


Definition of the natural logarithm 
Logarithm of special values 

Relating the logarithm to the exponential 
Identities 

Series expansions for the natural logarithm 
Derivative and integration formulae 


6.7 HYPERBOLIC FUNCTIONS 


6.7.1 
6.7.2 
6.7.3 
6.7.4 
6.7.5 
6.7.6 
6.7.7 
6.7.8 
6.7.9 
6.7.10 
6.7.11 
6.7.12 
6.7.13 


Definitions of the hyperbolic functions 
Range of values 

Hyperbolic functions in terms of one another 
Relations among hyperbolic functions 
Relationship to circular functions 
Series expansions 

Symmetry relationships 

Sum and difference formulae 

Multiple argument relations 

Sums of functions 

Products of functions 

Half-argument formulae 
Differentiation formulae 


68 INVERSE HYPERBOLIC FUNCTIONS 


6.8.1 
6.8.2 
6.8.3 
6.8.4 
6.8.5 


Range of values 

Relationships among inverse hyperbolic functions 
Relationships with logarithmic functions 
Relationships with circular functions 

Sum and difference of functions 


69 GUDERMANNIAN FUNCTION 


6.9.1 
6.9.2 
6.9.3 
6.9.4 


Fundamental identities 

Derivatives of Gudermannian 

Relationship to hyperbolic and circular functions 
Numerical values of hyperbolic functions 


6.10 ORTHOGONAL POLYNOMIALS 


6.10.1 
6.10.2 
6.10.3 
6.10.4 
6.10.5 
6.10.6 
6.10.7 
6.10.8 
6.10.9 
6.10.10 


Hermite polynomials 

Jacobi polynomials 

Laguerre polynomials 

Generalized Laguerre polynomials 
Legendre polynomials 

Chebyshev polynomials, first kind 
Chebyshev polynomials, second kind 
Tables of orthogonal polynomials 
Zernike polynomials 

Spherical harmonics 


6.11 GAMMA FUNCTION 


6.11.1 
6.11.2 
6.11.3 
6.11.4 
6.11.5 


Recursion formula 

Gamma function of special values 

Properties 

Asymptotic expansion 

Logarithmic derivative of the gamma function 
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6.12 


6.13 


6.14 


6.15 


6.16 


6.17 


6.18 


6.19 


6.11.6 | Numerical values 


BETA FUNCTION 


6.12.1 Numerical values of the beta function 


ERROR FUNCTIONS 

6.13.1 Properties 

6.13.2 Error function of special values 
6.13.3 Expansions 

6.13.4 Special cases 


FRESNEL INTEGRALS 

6.14.1 Properties 

6.14.2 Asymptotic expansion 

6.143 Numerical values of error functions and Fresnel integrals 


SINE, COSINE, AND EXPONENTIAL INTEGRALS 
6.15.1 Sine and cosine integrals 

6.15.2 Exponential integrals 

6.15.3 Logarithmic integral 

6.15.4 Numerical values 


POLYLOGARITHMS 


6.16.1 Polylogarithms of special values 
6.16.2 Polylogarithm properties 


HYPERGEOMETRIC FUNCTIONS 
6.17.1 Special cases 

6.17.2 Properties 

6.17.3 Recursion formulae 


LEGENDRE FUNCTIONS 

6.18.1 Differential equation: Legendre function 

6.18.2 Definition 

6.18.3 Singular points 

6.18.4 Relationships 

6.18.5 Recursion relationships 

6.18.6 Integrals 

6.18.7 Polynomial case 

6.18.8 Differential equation: associated Legendre function 
6.18.9 Relationships between the associated and ordinary Legendre functions 
6.18.10 Orthogonality relationship 

6.18.11 Recursion relationships 


BESSEL FUNCTIONS 
6.19.1 Differential equation 
6.19.2 Singular points 

6.19.3 Relationships 

6.19.4 Series expansions 

6.19.5 Recurrence relationships 
6.19.6 | Behavior as z > 0 
6.19.7 Integrals 

6.19.8 Fourier expansion 
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6.20 


6.21 


6.22 


6.23 


6.24 


6.25 


6.26 


6.27 


6.28 


6.29 


6.30 


6.31 


6.19.9 Auxiliary functions 

6.19.10 Inverse relationships 

6.19.11 Asymptotic expansions 

6.19.12 Zeros of Bessel functions 

6.19.13 Half order Bessel functions 

6.19.14 Modified Bessel functions 

6.19.15 Airy functions 

6.19.16 Numerical values for the Bessel functions 


ELLIPTIC INTEGRALS 

6.20.1 Definitions 

6.20.2 Properties 

6.20.3 Numerical values of the elliptic integrals 


JACOBIAN ELLIPTIC FUNCTIONS 
6.21.1 Properties 

6.21.2 Derivatives and integrals 

6.21.3 Series expansions 


CLEBSCH-GORDAN COEFFICIENTS 
INTEGRAL TRANSFORMS: PRELIMINARIES 


FOURIER TRANSFORM 

6.24.1 | Existence 

6.24.2 Properties 

6.24.3 Inversion formula 

6.24.4 Poisson summation formula 

6.24.5 | Shannon's sampling theorem 
6.24.6 | Uncertainty principle 

6.24.7 Fourier sine and cosine transforms 


DISCRETE FOURIER TRANSFORM (DFT) 
6.25.1 — Properties 


FAST FOURIER TRANSFORM (FFT) 
MULTIDIMENSIONAL FOURIER TRANSFORM 


LAPLACE TRANSFORM 


6.28.1 Existence and domain of convergence 
6.28.2 Properties 

6.28.3 Inversion formulae 

6.28.4 Convolution 


HANKEL TRANSFORM 
6.29.1 Properties 


HARTLEY TRANSFORM 


HILBERT TRANSFORM 
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6.31.1 Existence 
6.31.2 Properties 
6.31.3 Relationship with the Fourier transform 


6.32 Z-TRANSFORM 
6.32.1 Examples 
6.32.2 Properties 
6.32.3 Inversion formula 
6.32.4 Convolution and product 


6.33 TABLES OF TRANSFORMS 


6.1 TRIGONOMETRIC OR CIRCULAR FUNCTIONS 


6.1.1 DEFINITION OF ANGLES 


If two lines intersect and one line is rotated about the point of intersection, the angle 
of rotation is designated positive if the rotation is counterclockwise. Angles are 
commonly measured in units of radians or degrees. Degrees are a historical unit 
related to the calendar defined by a complete revolution equalling 360 degrees (the 
approximate number of days in a year), written 360?. Radians are the angular unit 
usually used for mathematics and science. The radian measure of an angle is defined 
as the arc length traced by the tip of a rotating line divided by the length of that 
line. Thus a complete rotation of a line about the origin corresponds to 27 radians of 
rotation. It is a convenient convention that a full rotation of 27 radians is divided into 
four angular segments of 7 /2 each and that these are referred to as the four quadrants 
designated by Roman numerals I, II, III, and IV (see Figure 6.1). 


6.1.2 CHARACTERIZATION OF ANGLES 


A right angle is the angle between two perpendicular lines. It is equal to т /2 radians 
or 90 degrees. An acute angle is a positive angle less than 7/2 radians. An obtuse 
angle is one between 7/2 and т radians. A convex angle is one between 0 and т 
radians. 


© 2003 by СКС Press LLC 


FIGURE 6.1 


The four quadrants (left) and notation for trigonometric functions (right). 


Ouadrants 


111 IV 


FIGURE 6.2 
Definitions of angles. 
21,1209 11,90% 17,60% 


$5,135? 1,459 


5,1502 єт,30° 


т,180° 07,07 


27,3609 
111,330% 
55,225? 15,315? 


47,2409 , 37,3007 
57,210? 


6.1.2.1 Relation between radians and degrees 


The angle 7 radians corresponds to 180 degrees. Therefore, 


180 
one radian — —— degrees — 57.30 degrees, 
T 


one degree — 10 radians — 0.01745 radians. 


6.1.3 CIRCULAR FUNCTIONS 


(6.1.1) 


Consider the rectangular coordinate system shown in Figure 6.1. The coordinate x 
is positive to the right of the origin and the coordinate y is positive above the origin. 
The radius vector r shown terminating on the point P(x, y) is shown rotated by the 
angle a up from the x axis. The radius vector r has component values x and у. 
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The trigonometric or circular functions of the angle a are defined in terms of 
the signed coordinates x and y and the length r, which is always positive. Note that 
the coordinate x is negative in quadrants II and III and the coordinate y is negative 
in quadrants III and IV. The definitions of the trigonometric functions in terms of the 
Cartesian coordinates т and y of the point P(x,y) are shown below. In formulae, 


the angle a is usually specified in radian measure. 


sine a — sin a = y/r, cosinea = cosa = z/r, 
tangenta = tana = y/z, cotangenta = cota = т/у, 
cosecant a = csc a = r/y, secant a = весе = r jz. 


There are also the following seldom used functions: 
versed sine of a = versine of a = vers a = 1 — cosa, 
coversed sine of a = versed cosine of a = covers a = 1 — sina, 
exsecant of a = exseca = seca — 1, 


haversine of a = hava = 2 versa = (1 — cos a). 


6.1.3.1 Signs in the four quadrants 


FIGURE 6.3 


Sine and cosine; angles are in radians. 
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(6.1.2) 


FIGURE 6.4 


Tangent and cotangent, angles are in radians. 
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Aas 1) 
AXR(US -1) 
-(24 V3) 
V2(V3 — 1) 
—V( 3 + 1) 
-(2- V3) 


Nm 1) 
—2(V3 +1) 
-Q- V3) 
у2(у3--1) 
-V2V3 – 1) 
-(2-- V3) 


6.1.5 EVALUATING SINES AND COSINES AT MULTIPLES OF т 


The following table is useful for evaluating sines and cosines in multiples of 7: 


TD eee [ even [тоё Гау оа [n]? even | 


sin n 0 0 0 0 0 
COS TT (—1)" +1 -1 +1 +1 
sin тт /2 18 239 аг 0 0 
cos nm /2 (02 0 —1 +1 


| ] n odd n/20dd ^ т/2 even 
(DHT (n^ 0 
Note the useful formulae (where i? = —1) 
nn intl nn Pul 
cd x os 2551-1" +1]. 1. 
sin 5 E [(—1) |; cos 7 5 [(—1)” + 1] (6.1.3) 


6.1.6 SYMMETRY AND PERIODICITY RELATIONSHIPS 
sin (—a) — — sin a, cos(—a) — +cosa, tan (а) = – tana. (6.1.4) 
When n is any integer, 
sin (a + n27) = sina, 
cos (a + n27) = cosa, (6.1.5) 


tan (a + пт) = tan a. 


6.1.7 FUNCTIONS IN TERMS OF ANGLES IN THE FIRST 
QUADRANT 


When n is any integer: 


3 
ШЕЕ [Frera] 
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6.1.8 ONE CIRCULAR FUNCTION IN TERMS ОҒ ANOTHER 


For 0 < 2 < 7/2, 


tan 2 
V1 + ап? 2 
1 
V1 + tan“ 2 


tan x 


V1 + tan“ 2 


tan x 


V1 + tan“ x 


V1+ cot? x 


cot x 
V1 + соё? z 


1 
соб 2 


М1 + соё? 2 


CSC Z V1 + соё? z 
Усвс22-1 cota 
vesc2 2 —1 | —— | cot x 


6.1.9 CIRCULAR FUNCTIONS IN TERMS OF EXPONENTIALS 


e” + е iz A з 

соз теср е^ = cosz +1 sln z 
iz —iz 
5 —€ E zii 
Ва = e = cos z — #sin z 
1 

sin z ei? —e čz : 

tanz = — = —————— where i“ — —1 and z may be complex 
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6.1.10 FUNDAMENTAL IDENTITIES 


1. Reciprocal relations 


р 1 
sin a = ; 
csca 
1 
csca = ———, 
sin a 


2. Pythagorean theorem 


3. Product relations 


1 
cosa = : tan a = 
seca 
1 
seca = ; cota = 
cos a 


sin? z + cos“ z 21 
sec“ z — tan“ z —1 


csc? z — cot? z —1 


sin a = tan ос сова cosa 
tan a = sina sec q cota 
seca = cscatana CSC Q 


4. Quotient relations 


. tan о 
sina = 
seca 
seca 
csc a = 
tana 


6.1.11 ANGLE SUM AND DIFFERENCE RELATIONSHIPS 


cota 
cosa = 

csc a 

csc a 
seca = 

cota 


sin a 


COS Q 
сова: 


sin a 


cot a sin a 


COS @ CSC @ 


seca cota 


tana = 


cota = 


sin (a + 8) = sina сов |3 + cosa sin 8 


cos (a + B) = cosa cos f F sina sin 8 


t +t 
tan (a + 8) = деше клн. апр 
1 F tana tan f 
t t 1 
ра E 


cot B + cota 


6.1.12 DOUBLE-ANGLE FORMULAE 


sin 2a = 2 sin Q созо = 


cos 2a = 2соз a — 1 


2tana 

1 — tan“ a 

сод a = 1 

cot 2a = ————— 
2cota 
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2tana 


1 + tan“ a 


1 — 2sin“ a = cos“ a — sin“ a = 


sina 


COS @ 


COS @ 


sina 


1— tan“ a 
1 + ап? a 


6.1.13 MULTIPLE-ANGLE FORMULAE 
sin За = —4 sin? a + 3sin a. 
sin 4a = —8 sin“ a cosa + 4sina cos a. 
sin 5a = 16 sin“ a — 20sin? a + 5sina. 


5a — 32sina cos? a + б зіп о cos a. 


sin ба = 32 sin a cos 
sinna = 2 ѕіп (n — l)a cos a — sin (n — 2)a. 
cos 3a = 4cos? a — 3 cosa. 

cos4a = 8cos! a — 8cos? a +1. 

cos Бе = 16 cos? a — 20 cos? a + 5 cos a. 

cos 6a = 32 cos? a — 48 cos“ a + 18 cos? a — 1. 
соз то = 2cos (n — 1)acosa — cos (n — 2)a. 


— tan? а +3tana 


ое —3{ап? а +1 
Grs —4tan? a + 4tana 
tan“ a — 6 tan? a + 1` 
tan (n — 1)a + tana 
tanna = 


— tan (n — lja tana +1" 


6.1.14 HALF-ANGLE FORMULAE 


a 1 + соѕа 
= = +,/———— 
сов > 2 


(positive if a /2 is in quadrant I or IV, negative if in П or Ш). 


TS 
se z кеша 
2 2 


(positive if a /2 is in quadrant I or II, negative if in Ш or IV). 


a 1 — cosa sin a 1—cosa 
tan = = —— = ——— = 4, | ——>— 
2 sin a 1+cosa 1+ cosa 


(positive if a /2 is in quadrant I or III, negative if in П or IV). 


a 1+cosa sin a 1+ cosa 
cot — = ————— = ——— = 4 | — 
2 sin a 1-сова 1 — cos a 


(positive if a /2 is in quadrant I or III, negative if in П or IV). 
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6.1.15 POWERS OF CIRCULAR FUNCTIONS 


1 1 
sin“ a — 24 — cos 2a). COS“ a = 24 + cos 2a). 
1 1 
sin“ a = ПЕ sin 3a + З sin a). cos? a = д\совЗе + 8соза). 
1 1 
sin“ a = ris —4cos2a+cos4a). costa = ris +4 cos2a + cos 4a). 
1 — cos2a 1 + cos 2a 
{ай үүсгэл, Qa ltr L, 
я 1 + cos 20 ч 1 — cos 20 


6.1.16 PRODUCTS OF SINE AND COSINE 


1 1 
cosa cos 8 = z cos(a — В) + 5 cos (a + B). 


sin a sin 8 = 5 cos (a — 8) — 2 сов (а + 8). 


1 1 
sin a cos 8 = 5 sin (a — 5) + узш (a + B). 


6.1.17 SUMS OF CIRCULAR FUNCTIONS 


sina + sin 8 = 2sin cos SEF 
a + а — 
cosa + cos B = 2 cos ae ~ 
а + . a— 
cosa — cos B = —2sin Ва B 
2 2 
sin a + 
кс cc OM. 
cos a cos 3 
sinGta 
КҮТЕ Lu 
sin a sin 8 
sina + sing _ бап 222 
sin a — sin f tan 28 ' 
sin a + sin 8 —a + B 
——— = cot : 
cosa — cos B 2 
sin a + sin 2 a+ 8 
—————— = tan 2 
cosa + cos B 2 
sin a — sin 2 a — © 
——< = tan ‹ 
cosa + cos д 2 
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6.2 CIRCULAR FUNCTIONS AND PLANAR 


TRIANGLES 
B 
B 
с а h 7 
А C A P uic ын e 
b b 
Right triangle General triangle 


6.2.1 RIGHT TRIANGLES 


Let A, B, and C designate the vertices of a right triangle with C the right angle and 
a, b, and c the lengths of the sides opposite the corresponding vertices. 


1. Trigonometric functions in terms of angle sides 


а 1 
S c  cscA' 
b 1 
A = = = —— 6.2.1 
is c  secA' ( ) 
а 1 
ТТР нек 
an b cotA 


2. The Pythagorean theorem states that a? + 02 = c?. 


3. The sum of the interior angles equals п, i.e., А+ В +С = т. 


6.2.2 GENERAL PLANE TRIANGLES 


Let A, B, and С designate the interior angles of a general triangle and let a, b, and с 
be the length of the sides opposite those angles. 


1. Radius of the inscribed circle: 


(s — a)(s — b)(s — с) (6.22) 


where the semi-perimeter is 


s=5(atbto), (6.2.3) 
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2. Radius of the circumscribed circle: 
a b c арс 
© 2sinA  2sinB  2sinC  4(Area) 


3. Law of sines: 
а b с 


sinA sinB sinC’ 


4. Law of cosines: 


а? = с + b? — 2be cos A, cos A = 
2bc 
а оар 
b? = а? + с? – 2сасоѕВ, cos В = 2 te 
2ca 
p 2002 
c = b? + а? — 2abcosC, cosC — аз шн 
2ab 
5. Triangle sides in terms of other components: 
a = bcos C + ccos В, 
с = bcos А +acosB, 
b = асоѕ С + ccos А. 
6. Law of tangents: 
a+b  tan4iB 
a—b {ап ALB | 
b+c tan Pic 
b—c {ап BIC | 
a+c tan ас 
а-с (аһ4-6” 
7. Area of general triangle: 
besin A acsinB — absinC 
Area — = = : 
2 2 
2 c? sin Asin В a b? sin Авіп С = a? sin B зїп С 
"2810 2888 25А ^" 
b 
za m = \/8(8 — a)(s — b)(s — c) (Heron's formula). 


8. Mollweide's formulae: 


a cosiA 7 
c—a sin (C — A) 
b cosiB ^' 
a—b sin (A — B) 
c — созС 
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9. Newton’s formulae: 


b+e 


cos (B — C) 


. 3 
sin n 


cos (C — A) 


, 


i 
sin 58 


NC: i(A- В) 


15521] 
sin 3C 


6.2.3 HALF-ANGLE FORMULAE 


sin — — m 

8.16909 
са 

sin Z 2 (8- ots — b) 


6.2.4 SOLUTION OF TRIANGLES 


A triangle is totally described by specifying any side and two additional parameters: 
either the remaining two sides (if they satisfy the triangle inequality), another side 
and the included angle, or two specified angles. If two sides are given and an angle 
that is not the included angle, then there might be 0, 1, or 2 such triangles. Two angles 
alone specify the shape of a triangle, but not its size, which requires specification of 


a side. 


6.2.4.1 Three sides given 


Formulae for any one of the angles: 


- 
Кере еш. х а 


ТЕПТЕР (s — с) 
sin Z = 
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FIGURE 6.5 


Different triangles reguiring solution. 


6.2.4.2 Given two sides (b, c) and the included angle (А) 


See Figure 6.5, left. The remaining side and angles can be determined by repeated 
use of the law of cosines. For example, 


1. “Non-logarithmic solution"; perform these steps sequentially: 


(a) a? = b? + с? — 2bc cos A 
(b) cos B = (a? + с? — b?) /2ca 
(c) соз С = (a? +b? — c?)/2ba 


2. “Logarithmic solution”; perform these steps sequentially: 


(b) tan 12 Е ice 2 
+ E 

() B= —— 
B+C B-C 

d = — 

oS БАРА 2 
sin 

ra sin B 


6.2.4.3 Given two sides (b, c) and an angle (C), not the included 
angle 
See Figure 6.5, middle. The remaining angles and side are determined by use of the 
law of sines and the fact that the sum of the angles is r (A + B + C = r). 
bsinC _ bsinA 


sin B — : Ажт-В-С, а - 2 
с sin В 


(6.2.4) 


6.2.4.4 Given one side (5) and two angles (В, С) 


See Figure 6.5, right. The third angle is specified by A = r — B — C. The remaining 


sides are found by 
bsin A bsinC 
= = н 2; 
sinB" ^" 'snB SARA 
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6.2.5 TABLES OF TRIGONOMETRIC FUNCTIONS 


(degrees) 
І sin x COST tan x cot x sec T CSC x 
0 0 1 0 +оо 1 +оо 
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(radians) 
x sin x созт tan x cot r sec x CSC I 
0 0 1 0 +оо 1 +оо 


0.1003 9.9666 10.0167 
0.2027 4.9332 5.0335 
0.3093 3.2327 3.3839 
0.4228 2.3652 2.5679 
0.5463 1.8305 2.0858 


0.6841 1.4617 1.7710 
0.8423 1.1872 1.5523 
1.0296 0.9712 1.3940 
1.2602 0.7936 1.2766 
1.5574 0.6421 1.1884 


1.9648 0.5090 1.1221 
2.5722 0.3888 1.0729 
3.6021 0.2776 1.0378 
5.7979 0.1725 1.0148 
14.1014 0.0709 1.0025 


+оо 0 1 
—34.2325 | —0.0292 1.0004 
—1.6966 | —0.1299 1.0084 
—4.2863 | -0.2333 1.0269 
—2.9271 | —0.3416 1.0567 
—2.1350 | -0.4577 1.0998 


—1.7098 | -0.5848 1.1585 
—1.3738 | -0.7279 1.2369 
-1.1192 | —0.8935 1.3410 
—0.9160 | —1.0917 1.4805 
-0.7470 | —1.3386 1.6709 


—0.6016 | —1.6622 1.9399 
—0.4727 | —2.1154 2.3398 
—0.3555 | —2.8127 2.9852 
—0.2464 | —4.0584 4.1797 
—0.1425 | —7.0153 7.0862 
—0.0416 | —24.0288 24.0496 

0 +оо +оо 
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6.3 INVERSE CIRCULAR FUNCTIONS 


6.3.1 DEFINITION IN TERMS OF AN INTEGRAL 


arc sin(z) = sin“ 


=f dt 
o М1-187 


1 
ďt T 
arc cos(z) = cos“) = | ——— =; sin! z, (6.3.1) 
4,1-0 2 
* dt 
arc tan(z) = tan“) z = SA БЕШТ 2 — cot! z, 


where z can be complex. The path of integration must not cross the real axis in 
the first two cases. In the third case, it must not cross the imaginary axis except 


1! 


possibly inside the unit circle. If —1 < x < 1, then sin““ x and cos“! z are real, 
-5 < sin“) z < 2, and 0 < cos7! т < r. 
csc ! z = sin“ (1/2), 
-1 -1 
sec 2 = соѕ (1/2), 
m sA а) (6.3.2) 
cot z = Фап (1/2), 
2 


86С ropes z = q/2. 


6.3.2 PRINCIPAL VALUES OF THE INVERSE CIRCULAR 
FUNCTIONS 


The general solutions of {sin Ё = z, cost = 2, tant = 2} are, respectively: 


t — sin“! z = (—1)*tg + kr, with sin tg = z, 
t=cos z = +t, +2kr, with sin t1 = z, 
t= tan“! z = to + Ет, with sin tg = z, 


where k is an arbitrary integer. While “іп”! x" can denote, as above, any angle 
whose sin is т, the function sin“! x usually denotes the principal value. The princi- 
pal values of the inverse trigonometric functions are defined as follows: 


1. When -1 <a <1, еп —7/2 < sin“! < 72/2. 
2. When —1< <1, then 0 < cos! g «m. 

3. When —œ < 7 < oo, then —7/2 < tan“! x < 1/2. 
4. When 1<r, then 0 < све g < т/2. 
When x < —1, then —т/2 € cse“! x < 0. 

5. When 1 <a, then 0 < sec“! g < r/2. 
When x < —1, then 1/2 < sec“! x < т. 


6. When —оо < x < оо, then 0 < сої! = < r. 
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6.3.3 FUNDAMENTAL IDENTITIES 
sin“! z + cos“! z = 1/2. 
tan ! x + cot“) z = n/2. 


If a = sin! т, then 


) т 
sin a — r, cosa = V1— 17, tan a = 


м1 — 22 
1 1 р V1 — 22 
csca = — seca = ———— cota = . 
а= =, a Tm a 3 
If a = cos“! т, then 
: [52 
sina = y 1 — 17, созо = r, tan a — 
z 
1 1 А т 
csca = ; seca = —, cota = : 
м1 — 22 x V1— 22 
If a = tan“! т, then 
: т 1 i 
sina = Я cosa = | an a = r, 
V1+ 2? V1+ 22 
Мт? 
csc Q = ый. : seca = V1 + 22, cota — — 
z 
6.3.4 FUNCTIONS OF NEGATIVE ARGUMENTS 
sin“) (—z) = — sin“) z, sec! (—z) = r — sec“! z, 
cos | (—z) = r — cos“! z, esc! (—z) = — сөс 12, 
tan“) (—z) = — tan“! z, cot (—z) = r — cot ^! z. 


6.3.5 RELATIONSHIP TO INVERSE HYPERBOLIC FUNCTIONS 


sin“) z = —isinh ! (iz), csc | = isch! (iz), 


—1 z = —itanh ! (iz), cot"! z = icoth ! (iz). 


ct 
2 
B 
ә 
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6.3.6 SUM AND DIFFERENCE OF TWO INVERSE CIRCULAR 
FUNCTIONS 


sin“) 21 + sin“) 29 = sin“) — 22 + 224/1 — at) ; 


cos! 2 + соз 122 = cos)! (а + 4/(1— 22)(1 — 3). 


21 + 2 
tan“! 21 + tan“! 29 = tan“ (а : 2 ) 
1 F 2123 


sin“! z1 + cos)! 25 = sin“! c +4/(1—22)(1- 4) 
= cos“) (: 21/1 — 2? — 


1 2122 +1 22 ATA 
22 F 21 2123 +1 


tan“! 21 + cot! 29 = tan 


6.4 CEILING AND FLOOR FUNCTIONS 


The ceiling function of x, denoted [x], is the least integer that is not smaller than x. 
For example, [7| = 4, [5] = 5, and [-1.5] = — 

The floor function of x, denoted |x], is the largest integer that is not larger 
than т. For example, [| = 3, [5] = 5, and |—1.5] = — 


6.5 EXPONENTIAL FUNCTION 


6.5.1 EXPONENTIATION 
For a any real number and m a positive integer, the exponential a™ is defined as 
a" —a:a:a: а. (6.5.1) 
_—„—— 
m terms 

The following three laws of exponents follow for a Z 0: 

1. a” a” а, 

a”, ifm>n, 
ifm=n, 


ifm<n. 
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3. (алуа = a(mn), 
The n® root function is defined as the inverse of the n“ power function: 
If b" =a, thenb = Ya=al/”, (6.5.2) 


If n is odd, there will be a unique real number satisfying the above definition of 
V/a, for any real value of a. If n is even, for positive values of a there will be two 
real values for %/a, one positive and one negative. By convention, the symbol a 
means the positive value. If n is even and a is negative, then there are no real values 
for 4/а. 

To extend the definition to include a? (for t not necessarily a positive integer) so 
as to maintain the laws of exponents, the following definitions are required (where 
we now restrict a to be positive; p and q are integers): 


а —1 а/е = Ҹа? а= —. (6.5.3) 
ат 
With these restrictions, (һе second law of exponents can be written as — = ма: 


а 
If a > 1, then the function a“ is monotonically increasing while, if 0 < a < 1 
then the function a? is monotonically decreasing. 


6.5.2 DEFINITION OF е? 


Z m 
exp(z) = е? = lim (1 + =) 
m— 00 m 
5.4 
PINE E с (654) 
51 + ЕТІ + T deu 
If z = x + iy, then e? = e*e = e” (cosy + i sin y). 
The numerical value of e is given on page 15. 


=1+2+ 


20 
15 
10 
5 
0 B^ 
-3 -2 -1 0 1 2 3 


6.5.3 DERIVATIVE AND INTEGRAL OF e” 


The derivative of e“ is e“. The integral of e? is e?. 
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6.6 LOGARITHMIC FUNCTIONS 


6.6.1 DEFINITION OF THE NATURAL LOGARITHM 


The natural logarithm (also known as the Napierian logarithm) of z is written as In z 
or as log, z. It is sometimes written log z (this is also used to represent a “generic” 
logarithm, a logarithm to any base). One definition is 


nz = f 24 (6.6.1) 
1 1 


where the integration path from 1 to z does not cross the origin or the negative real 
axis. 

For complex values of z the natural logarithm, as defined above, can be repre- 
sented in terms of its magnitude and phase. If z = x + iy = re?“, then 


In z =Inr+i(6+ 257), (6.6.2) 
for some k = 0, +1,..., where r = \/2?+y?, т = rcos@, and y = тіп. 
Usually, the value of k is chosen so that 0 < (0 + 2km) < 27. 


6.6.1.1 Logarithms to a base other than e 


The logarithmic function to the base a, written log ,, is defined as 


_ log,z _ nz 


log, 2 (6.6.3) 


~ logga Ina’ 


Note the properties: 


1. log, a? — p. 
2. log, b — : 
ова log, a 
In 2 
3. logigz = 110. (logy) €) In z z (0.4342944819) In z. 


4. In z = (In 10) logio z © (2.3025850929) logy, 2. 
6.6.2 LOGARITHM OF SPECIAL VALUES 


In0 = —oo, In 1 — 0, Ine — 1, 


In (-1) = in +2rik, In (+i) = +7 +2rik. 
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6.6.3 RELATING THE LOGARITHM TO THE EXPONENTIAL 


For real values of z the logarithm is a monotonic function, as is the exponential. Any 
monotonic function has a single-valued inverse function; the natural logarithm is the 
inverse of the exponential. If x = e", then y = In z, and x = е"%, The same 
inverse relations hold for bases other than e. That is, if u = a“, then w = log, u, 
and u = ава, 


6.6.4 IDENTITIES 


log, 2122 = log, 21 + log, 22, for (—r < arg zı + arg za < m). 
21 
log, т log, 21 — log, 22, for (—r < arg zı — arg ža < m). 
2 
log, z” =nlog, 2, for (-т < narg z < т), when n is an integer. 


6.6.5 SERIES EXPANSIONS FOR THE NATURAL LOGARITHM 


In(Le2) 227 ga +i., for |z| < 1. 
2-1 ЫШТАР ав 1 
6.6.6 DERIVATIVE AND INTEGRATION FORMULAE 
а z 1 dz 


Lm — = nz, ага —zlnz — z. 
dz 2 2 


6.7 HYPERBOLIC FUNCTIONS 


20 
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6.7.1 DEFINITIONS OF THE HYPERBOLIC FUNCTIONS 


ee”? 1 
sinh z = ————, csch z = ——, 
2 sinh z 
е? +07? 1 
cosh z 2 ————, sech z = ———, 
2 cosh z 
e*—e* sinhz 1 
tanh z = ———— = : coth z = ——. 
e” +erž | coshz tanh z 
When z = x + iy, ши os +1512 
sinh 2x + i sin 
sinh z = sinh z cos y + i cosh z sin y, tanhz — ш 


cosh 22 + cos 2y ' 

h h халаах th sinh 2z — i sin 2y 

cosh z = cosh z cos y + i sinh z sin cothz = --------. 
Ч А cosh 2x — cos 2y 


6.7.2 RANGE OF VALUES 


Domain Range 


Function (interval of u) (interval of function) 


Remarks 


Two branches, 
pole at u — 0. 


Two branches, 
pole at u — 0. 


h 
+v/(cosh z)? — 1 Е е. 
1 — (tanh x)? 
1 


1 + (sinh x)? cosh x -_————= 
) 1 — (tanh z)? 


sinh x " (coshz)? — 1 
1 + (sinh x)? cosh x 

215 " 1 1— (tanhz)? 

sinh x (cosh x)? — 1 tanh x 


tanh x 


1 1 


M — 1 — (tanh x 2 
1+ (sinh x)? cosh x ( ) 


1 + (sinh z)? cosh x 
sinh x (cosh x)? — 1 
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1 — (sech x)? 1 
csch т sech a (coth x)? — 1 
às (csch z)? +1 1 Ж coth r 
csch x sech 2: (coth x)? — 1 


1 1 
+4/1 — (sech x)? 


(csch z)? +1 coth x 
sech т 


csch т +-—————= | +)/(cothz)? — 1 
1 — (sech x)? 


csch x -— = (coth x)? — 1 
(csch r)? + 1 coth x 


/(csch x)? + 1 


coth x 


ja Ме. 
1/1 — (sech x)? 


6.7.4 RELATIONS AMONG HYPERBOLIC FUNCTIONS 
e“ — cosh z + sinh z, e ^ = cosh z — sinh z, 


(cosh z)“ — (sinh z)“ — (tanh z)“ + (sech z)“ — (coth z)“ — (csch z)“ — 1. 


6.7.5 RELATIONSHIP TO CIRCULAR FUNCTIONS 


cosh z = cosiz, sinh z = —isiniz, tanh z = —itaniz. 


6.7.6 SERIES EXPANSIONS 


2 4 6 


“ЖЭ аг Ёл, 
cosh z = For tar tm tee |z| < oo. 
. CU E DONE d 
sinh z =z + tu tv : |z| < oo 
taah 25 (22 17250 Дет 
nhz = z — > + — — —— +... — 
тош i : 
6.7.7 SYMMETRY RELATIONSHIPS 
cosh (—z) = + cosh z, sinh (—z) = — sinh z, tanh(—z) = — tanh z. 
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6.7.8 SUM AND DIFFERENCE FORMULAE 
cosh (21 + 23) = cosh 21 cosh 22 + sinh 21 sinh 22, 
sinh (21 + z2) = sinh 21 cosh za + cosh 21 sinh 22, 
fat iy tanh 21 + tanh z2 2 sinh 221 + sinh 225 
1+tanhz,tanhz. соѕһ 221 + cosh 223" 
| 1 £cothz coth 22 sinh 221 F sinh 222 


coth (21 +22) OSA O ao O, 
(а + 22) coth 21 + cothz» соѕһ 221 — cosh 225 


6.7.9 MULTIPLE ARGUMENT RELATIONS 
2tanha 


1 — tanh“ a` 
sinh За = 3sinh a + 4sinh“ a = sinh a(4 cosh? a — 1). 


sinh 2a = 2 sinh a cosh a = 


sinh 4a = 4sinh“ a cosh a + 4 cosh? a sinh a. 

cosh 2a = cosh? a + sinh? a = 2 cosh? a — 1, 

1 + tanh? a 

1—tanh? a 

cosh За = —3 cosh a + 4 cosh? a = cosh a(4 sinh? a + 1). 


= 1 +2sinh“ a = 


cosh 4a = cosh“ a + 6 sinh? a cosh? a + 6 sinh* a. 


2 tanh 
puo x EHE. 
1 + tanh“a 
h h? 
—— 3tan п шш a 
1+ 3tanh’ a 
1+coth“ a 
th 2a = ————— 
мисс 2cotha 
h n? 
coth 3a = 601 a + coth” a 


1+ 3coth“ a 


6.7.10 SUMS OF FUNCTIONS 
sinh u + sinh ш = 2sinh — T cosh g^ 


u +w и — ш 
cosh 2^ 


cosh и + cosh ш = 2 cosh 


cosh u — cosh w — 2sinh “= sinh = x 


sinh u + w 


tanh и + tanh w = ——— ————, 
cosh u cosh w 


sinh u + w 


coth u + coth w = —————. 
$ s sinh u sinh w 
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6.7.11 PRODUCTS OF FUNCTIONS 


1 

sinh u sinh w = 2 (cosh(u + w) - cosh(u — w)), 
1 

sinh u cosh ш = 2 (sinh(u + w) + sinh(u — w)), 


1 
cosh u cosh ш = 5 (cosh(u + w) + cosh(u — ш)). 


6.7.12 HALF-ARGUMENT FORMULAE 


2 cosh z — 1 2 совһ2--1 
1 һ—=+ү/———— һ---/--- 
sin 2 2 , cos 2 + 2 ў 

2 cosh z — 1 sinh z 2 совһ2--1 sinh z 
tanh— = +4 / ——— = —— — th — = +| — = — 
атс Vcoshz+1  coshz+1’ corny Vcoshz—1  coshz-1 


6.7.13 DIFFERENTIATION FORMULAE 


inh h 

ш = cosh z, коше = ginh z, 
dz 
dtanh z dcsch z 
= h 2 = — h h 

FP (sech z)“, d: csch z coth z, 
dsech z dcoth z 

S sech z tanh z, T: (csch 2) 


6.8 INVERSE HYPERBOLIC FUNCTIONS 


2 ағ 2 dt йл dt 
cosh“! z = | : зіп! z = 1 — 5, tanh! z = f —. 
0 2-1 0 1+ o 1— f 


6.8.1 RANGE OF VALUES 


Odd function 
Even function, double valued 
Odd function 


Odd function, two branches, 
Pole at u = 0 

Double valued 

Odd function, two branches 
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6.8.2 RELATIONSHIPS AMONG INVERSE HYPERBOLIC 


FUNCTIONS 


TUE 


sinh"! x 
+sinh“! Vr? —1 


т 


м1 — 12 


sinh! 
1 
sinh! = 
x 
+ sinh“! 


sinh! 


1 
csch“! = 
x 


+ csch“! 


м1 — 12 


т 


сс} 


-1 
csch x 


т 


=] 
+ csch 
EY 


csch x? — 1 
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+ cosh“! Vr? +1 


cosh ^! x 
1 


V1 — 22 
Ү1--а? 
т 


+ cosh“! 
+ соз! 


1 
cosh! = 
x 


+ cosh“! — т) 
а2-1 


1 
V1 + 22 


+ sech“! 
1 

sech“! = 

x 


+ вес! V1 22 


т 


V1 + 22 


+ sech“" 


т 
V1+ 2? 
ма? – 1 


2 
tanh! x 


tanh7! 


+ tanh! 


1 
v14+2? 


+tanh7! VI 22 


tanh7! 


1 
tanh7! = 
2 


v1+2? 
2 


coth“! 


т 


v22—1 


+ со! 
1 
со! = 
2 
со Vi + 22 
1 
+coth“! ——— 
V1 — 22 


coth“! z 


6.8.3 RELATIONSHIPS WITH LOGARITHMIC FUNCTIONS 


livl 2 
sinh“! x = log (= + Vr? + 1), csch“! x = log (уе) : 
т 


1+%V1 — 22 
созһ x = log (= + V 12 — i sech ^! x = log (уе), 
x 
1 1 1 1 
tanh! = Slog (22), coth™! x = 5 log (241). 


6.8.4 RELATIONSHIPS WITH CIRCULAR FUNCTIONS 


sinh ^! x = —isin“! iz sinh“ ir = + sin“! x 
бап! x = —i tan“! iz бап! ix = +itan“! z 
csch“! g = +icsc™! iz csch“! iz = —icsc i x 
со! z = +icot“! iz coth ! iz = сов! x 


6.8.5 SUM AND DIFFERENCE OF FUNCTIONS 
sinh! x + sinh““ y sinh ^! (zv 1+0? tyV1 + g) | 
cosh ! x + cosh ! y = cosh™* (ғу + y (у? – 1) (2? — D) Я 


ik 
tanh ! x + tanh““ y = байд! ( 20 ) : 
zy +1 


її x + cosh”! y = sinh! (ғу +y (1 + 22) (2 — 1)) : 
= cosh“! (uv 1+2? + туу? — 1) : 


1 


tanh“ z + coth““ y = tanh 
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6.9 GUDERMANNIAN FUNCTION 


2 


| 
сл 

| 
w 

| 
= 

8 

н 
w 
сл 


This function relates circular and hyperbolic functions without the use of functions 
of imaginary argument. The Gudermannian is a monotonic odd function which is 
asymptotic to +5 as r — “оо. It is zero at the origin. 


84 r = the Gudermannian of x 


* dt 
= ! = 2{ап ! (tanh >) = 9tan-!e? Т. 
o cosht 2 2 


the inverse Gudermannian of x 


(6.9.1) 


gd x 


= Л L = log [tan (1 + 2)| = log (sec x + tan x). 


If gd(z + iy) = a + iB, Шеп 


sinh x sin 
tana = : tanh 8 = 5 
COS y cosh x 
sina sin д 
tanh 2 = : tany = 
osh 8 y cosh о 


6.9.1 FUNDAMENTAL IDENTITIES 


tanh (5) = tan ЕЭ! 


e” = cosh 2 + sinh x = sec gd x + tan gd r, 


Ere (1 " E) Е 1+ sin (gd x) 


4 2 cos(gd x) 


igd x = қа (ix), where i = V—1. 


6.9.2 DERIVATIVES OF GUDERMANNIAN 


-1 
1811) = sech 2 ш; 2) = SEC Z. 
dx dx 
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6.9.3 RELATIONSHIP TO HYPERBOLIC AND CIRCULAR 


FUNCTIONS 
sinh = tan (gd x), csch x = cot (gd x), 
cosh x — sec (gd x), sech x = cos (gd x), 
tanh x = sin (gd x), coth x = csc (gd x). 


6.9.4 NUMERICAL VALUES OF HYPERBOLIC FUNCTIONS 


0 1 —oo 0 0 1 0 


1.1052 
1.2214 
1.8499 
1.4918 
1.6487 


1.8221 
2.0138 
2.2255 
2.4596 
2.7183 


3.0042 
3.3201 
3.6693 


4.0552 
4.4817 


4.9530 
5.4739 
6.0496 
6.6859 
7.3891 


8.1662 
9.0250 
9.9742 
11.0232 
12.1825 


13.4637 
14.8797 


continued on next page 
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; 16.4446 8.1919 | 8.2527 
18.1741 9.0596 | 9.1146 
20.0855 10.0179 | 10.0677 


22.1980 11.0765 | 11.1215 
24.5325 12.2459 | 12.2866 
27.1126 13.5379 | 13.5748 
29.9641 14.9654 | 14.9987 


33.1155 16.5426 | 16.5728 


36.5982 18.2855 | 18.8128 
40.4473 20.2113 | 20.2360 
44.7012 22.3394 | 22.3618 
49.4024 24.6911 | 24.7113 
54.5982 27.2899 | 27.3082 


6.10 ORTHOGONAL POLYNOMIALS 


Orthogonal polynomials are classes of polynomials, (p (ж) +, which obey an orthog- 
onality relationship of the form 


n Dn (x) pm (z) dz = Сабат (6.10.1) 
I 


for a given weight function w(x) and interval Т. 


6.10.1 HERMITE POLYNOMIALS 


Symbol: Н,(т). 
Interval: (-оо, оо). 
Differential equation: y" — 2xy' + 2ny = 0. 


[1/2] —2 
БУШТІРЛІ ШЕШ 
Explicit expression: Н,,(2) = 2, n 
Recurrence relation: Hj 41(x) = 2x Hp (x) — 2n Ha (x). 


Weight: en? 
Standardization: Н,(а) = 2^z" +.... 
со 


Norm: | e* [Hn (2) dz = 2°ю\\/л. 


d"? 
Rodrigues’ formula: H (2) = (nur uer) 
oo 2" 3 5 
Generating function: 5 Hale) = а HAE 


n=0 
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Inequality: |Hp (x)| < V2"e**n!. 


6.10.2 JACOBI POLYNOMIALS 

Symbol: ре” (ғ). 

Interval: |-1, 1]. 

Differential equation: (1 — x?)y" +18 o — (a-- 8 -2)z]|y' - n(n - oi.d- 8 -1)y = 0. 
Explicit expression: 


PO) (1) = x v (" = °) tá 2 A (£ — 1)"—"(ж +1)". 


fym п-т 
Recurrence relation: 2(n +1)(n + о + 8 + 1)2n +a + B) P&P) (x) 
= (2n +a + B + 1)[(o? — 8?) + (2n +a + 8 + 2)(2n +a + 8)2]Р(8) (r) 
— 2(n + a)(n + B)(2n +a + 8 + 2) PP (1). 
Weight: (1 — x)“(1 + x)?. 


Standardization. Р.Ә 9 (1) = (" i °) : 
n 


2°+81T(n ъа + 1)T(n 4 8 + 1) 
(2n 4- a 4- B + 1)n'T (n t- o 4 B 4-1) 


NETER [1 — 2)***(1 + 2)^*^]. 


Norm: [ (1—a)*(1+2)° [c dz = 


-1 
Rodrigues" formula: plo) (x) 


со 


Generating function: Уу Р(9%8) (g) 2" = 29588-11-24-Н)“(1-2--8)7, 


n=0 
where R = v1 — 2х2 + z? and |z| < 1. 
(739) > па if g = max(a, 8) > —3 
ту” 5 E n s , Үс 2? 
Inequality: ECT ке 8) 21 = [7% -1/2, 1 


sn if g = max(a, 8) < —5, 


where a, > 1 and z' (in the second result) is one of the two maximum points 
nearest (8 — a) /(a + B + 1). 


6.10.3 LAGUERRE POLYNOMIALS 


Symbol: Ly (x). 
Interval: (0, оо). 
І.,(>) is the same as 10 (x) (see the generalized Laguerre polynomials). 


6.10.4 GENERALIZED LAGUERRE POLYNOMIALS 


Symbol: Le (x). 
Interval: [0, со). 
Differential equation: zy" + (a + 1 — z)y' + ny = 0. 


n 
21)" 
Explicit expression: L® (a) = 5 = 2 T 7 


т! n— m 
m=0 
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Recurrence relation: 
(n 4- 1)L (a) = [Qn +a + 1) — z] EA? (z) — (n +a) EA (ж). 
Weight: 2677, 


Standardization. L‘ (x) = с) gu... 
n! 
нэ 2 Г 1 
Norm: ! rre? (ж ) dx = Matat + T Es ) 
0 n: 
; 1 а" = 
Rodrigues’ formula: L‘ (y) = ———— [1"+2e77]. 


со 
Generating function: 5 LO (x)z” = (1 — z) 79“! exp ( = ) 


2-1 
n=0 
n+a+1 : 
Inequality: |2 (z ) « waar) e d cou die 
fp — roten et. ifz»0and-1«a «0. 
Note that a > —1 and LY? (ж) = (—1) £ [Ly c (2)] 


6.10.5 LEGENDRE POLYNOMIALS 


Symbol: P, (x). 
Interval: |-1, 1]. 
Differential equation: (1 — z?)y" — 2xy' + n(n + 1)y = 0. 


1 мт, n A (2n — 2m 
Explicit expression: Р, (х) = — > сәу ( ас 
n 
P 


Recurrence relation: (n + 1) Py4i(x) = (2n + 1) 2Р, (£) — nPn-1 (1). 
Weight: 1. 
Standardization: Р,(1)- 1. 


1 
2 

: P, 2 = ——. 
Norm ft n(x)] dx 5221 
Rodrigues’ formula: Р,,(2) = шалыг (1 —т?)"] 

z ! Ч ~ Pn! da^ ) 
Generating function: Уу P,(x)z” = (1 — 2zz + 22)-!/2, 

n=0 


for —1 < x < 1 and |z| < 1. 
Inequality: |P (x)| < 1 for —1 € x < 1. 


See Section 6.18.7 on page 556. 


6.10.6 CHEBYSHEV POLYNOMIALS, FIRST KIND 


Symbol: T, (x). 
Interval: [—1,1]. 
Differential equation: (1 — z?)y" — zy +n?y = 0. 


[n/2] 
n (n — m — 
Explicit expression: Т, (x) = cos (п cos! x) == > (—1)"—____— 
Vin — ! 
2 4-4 m!(n — 2m)! 
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1)! (jv um 


Recurrence relation: T444(z) = 22Tn (£) — Ty 1(x). 
Weight: (1 — 1?)-!/2. 
Standardization: T,(1) = 1. 


1 
отт: —т?)-1/ 2 2830 ке 
Norm: Га a?)- M? Г,(4)| ас um ein) 


Rodrigues’ formula: Т. (2) = ———————— ыш A [a - ууз 
(-2)^T(n + 2) dx” | 
= 1-22 
с її Поп: Т, n = ———__—_.. for -1 1 and 1. 
enerating function 2 »(2)2 [=o < z < land [2| < 
Inequality: (Т,(4)| € 1, for -1 € x <1. 


Note that T^, (ж) тутук 1/2719) (2). 


6.10.7 CHEBYSHEV POLYNOMIALS, SECOND KIND 


Symbol: U, (x). 
Interval: |-1, 1]. 
Differential equation: (1 — z?)y" — 3xy' + n(n + 2)y = 0. 
[n/2] 
—1)" (m — n)! 
Explicit expression: U, (x) = 5 шаг 
£—, m(n- 2m)! 
i 1)0 
Un (cos 4) = kat] 0 | 
зїп 0 
Recurrence relation: U 11 (2) = 220, (x) — U, —1 (7). 
Weight: (1 — 1?)!/2. 
Standardization: U, (1) = п + 1. 
1 


Norm: | (1-2) [Vaj] de = 5. 


2 
(— 1)” (n + 1) ут Lu (1 5 q2)nt0/2). 
(1 — т?)!/7?2"+1Г(п + 3) de” 
со 
1 
Generating function: 2.00)? 10007 for —1 <a < 1 and |z| < 1. 
Inequality: |Un (x)| < n +1, for C1 € z < I. 


Note that U,(«) = GEDA pia 1/2 (g ). 


(2 yore 


Rodrigues’ formula: Un (£) = 


6.10.8 TABLES OF ORTHOGONAL POLYNOMIALS 


Но =1 x). = (30240Н0 + 75600 H> + 2520094 + 2520 He + 90Н» + Н10)/1024 


Hı = 2x x? = (15120H, + 10080 H; + 1512H; + 72H + Но)/512 
Н» = 4x“ —2 x8 = (1680Ho + 3360 H> + 840Н + 56.Нв + Hs) /256 
Нз = 8x? — 12x x“ = (840H, + 420H3 --42Н; + Ну) /128 
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H4 = 16х* — 4817 + 12 az? = (120Ho + 180H> + ЗОНА + Н6)/64 


H; = 32x? — 16022 + 1202 ax» = (60H; + 20H3 + Hs) /32 
He = 64x9 — 480x“ + 720x? — 120 z^ = (12Ho + 12H> + H4)/16 
Hy = 128x" — 134415 + 336047 — 16802 x? = (6H, + H3)/8 
Ha = 2561x — 358419 + 134407“ — 1344022 + 1680 а? = (2Ho + Н»)/4 
Нә = 512x? — 9216x" + 4838417 — 806402° + 302402 x = (Н\)/2 
Hio = 10241)? — 23040х° + 16128019 — 40320024 + 3024002? — 30240 1- Ho 
Lo=1 тб = 72010 — 43201) + 1080015 - 144001; + 1080014 - 432015 + 720% 
Li --а--1 x» = 120Lo — 6001, + 12007.» - 1200L3 + 600174 — 1201 
Ly = (a? — 4x + 2)/2 x) = 24L0 — 9611 + 1441» — 9613 + 24L4 
Із = (—a? + 9x7 — 18x + 6)/6 r? = 6Lo — 18L, +181 — 613 
La = (x^ — 162° + 72x7 — 96x + 24)/24 x = 210 — 4L, +21» 
Ls = (—a? + 251“ — 200x? + 600x? — 600x + 120) /120 х = Lo — Іл 
Le = (x9 — 36x? + 450x“ — 2400x? + 540022 — 4320x + 720) /720 1= Lo 


Ро =1 x? = (41995 + 161502 + 15504Р + 7904Ps + 2176P + 256P10)/46189 
т 


Р, = x? = (3315P, + 4760Р» + 2992P; + 960P; + 128P4)/12155 
Р» = (За? — 1)/2 x = (715Ро + 2600P> + 2160P, + 832Р; + 128Р,)/6435 
Рз = (5x7 — 3x) /2 x“ = (143P, + 182P; + 88P; + 16Р;)/429 
P, = (35x) — 302? + 3) /8 xê = (33Р + 110P> + 72P, + 16Р) /231 
Ps = (630° — 70x? + 152) /8 x = (27P, + 28P3 + 8P5)/63 
Ps = (23115 — 315x“ + 105z? — 5)/16 x) = (7Po + 20Р + 8P4)/35 
Р; = (42917 — 693x + 315z — 35x) /16 а = (3P, + 2P3)/5 
Ps = (6435x — 1201226 + 6930: — 1260x? + 35) /128 т? = (Po + 2P>)/3 
Р» = (121551? — 25740x" + 18018x — 4620x? + 315x) /128 x = Р, 
Pio = (46189219 — 10939522 + 90090х° — 300302“ + 346517 — 63) /256 1= Р, 
To = 1 219 = (1267) + 2107» + 12074 + 4576 + 1073 + Tio) /512 
Т =a x? = (126T, + 8473 + 3675 + 97; + To) /256 
Т» = 21? – 1 xê = (35Т + 567» + 28T4 + 8T6 + Т»)/128 
Ts = 4x? — 3x x) = (3571 + 2173 +774 + Tr) /64 
Ts = 8x) — 8x7 +1 xê = (1076 + 157 + 6T4 + Ts) /32 
Ts = 16x — 20x + 5x x» = (107, + 573 + T5)/16 
Ts = 3219 — 48x“ + 18x7 — 1 z^ = (3To + 4Т» + Tx) /8 
T; = 64x" — 112x + 56x? — 7x z? = (3T, + T3)/4 
Ta = 12828 — 25675 + 160x“ — 322? +1 т? = (To + Т)/2 
Т» = 256х° — 576x" + 432x — 120x + 9x x = Т 
Tio = 512х!9 — 1280х2° + 1120х° — 400x“ + 5022 — 1 1=T 
U =1 x = (420 + 9005 + 75074 + 35076 + 9Us + U10)/1024 
U, — 2x x? = (421Л + 48U3 + 2705 + 8U; + Uo) /512 
U» = 4x? —1 аё = (1400 + 28U> + 20U4 + 705 + Uz) /256 
U3 = 8x7 — 4x x) = (14U, + 14U3 + 6U; + Uz) /128 
Us = 16x“ — 122? +1 x° = (500 + 90» + 5U4 + Ug) /64 
Us = 3225 — 3213 + 6x х5 = (BU: + 4U3 + Us) /32 
Us = 6419 — 802° + 24x? — 1 z^ = (2Uo + 3U> + U4)/16 
U, = 1282" — 1922? + 80x? — 8x x? = (211 + U3)/8 
Us = 25677 — 44826 + 2401“ — 402? +1 а? = (Uo + U2)/4 
Uo = 512x? — 10241" + 672x — 160x + 10x x = (Ui)/2 
Uio = 10924219 — 230425 + 1792x9 — 560x“ + 60x? — 1 1= 10 
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6.10.8.1 Table of Jacobi polynomials 
Notation: (т), = m(m +1)... (m+ n — 1). 


PP (1) 21. 

PP) (2) =;(Ф(в +1) + (a B4 2)(z — 1). 

PLP (к) = (до +1)» + (а + B + 3)(a +2)(z — 1) + (а +B + 3): (2 — 18) 
PLO) (а) = (a+1)3 + 12(a + B +4)(a + 2)5(а — 1) 


AG 
+ 6(a + 8 + 4)o(a + 3)(@ — 1)? + (a +8 + 4)a(@ — 1)°). 
PO (s) = =. аа (16(0 + 1)4 +32(a +8 +5)(a +2)» (2-1) 

+ 24(a+ B + 5)2(a + 3)2(1 — 1)? +8(a + B + 5)з (0 + 4)(ж — 1)? 
+ (а B San – 1)*). 


6.10.9 ZERNIKE POLYNOMIALS 


The circle polynomials or Zernike polynomials form a complete orthogonal set over 
the interior of the unit circle. They are given by 


U™ (р, 0) = R™ (re? (6.10.2) 


where А? (r) are radial polynomials (see below), n and m are integers with n — |m| 
even and 0 < |m| € n. 


6.10.9.1 Properties 
1. Orthogonality 


27 
І [ Um U(r, 8)U. (1,8) r dr dd = ——-б бол 
Ж : (6.10.3) 
19 НД (r) Вт (r) rdr = 204 D" 


2. Explicit formula for the radial polynomials 
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3. Expansions in Zernike polynomials 


(a) If f(r, 0) is a piecewise continuous function then 


со 


f(r,9) = 5 > А7 (т, 0) where n — |m| is even. 


n20 m2—n 


2 — n+ 1 27 1 
An = Аһ" = От (т, 0) f (r, Ө) т dr dð. 
T Jo Jo 


(b) If f(r, 0) is a real piecewise continuous function then 


f(r, 8) 


n=0 m=0 


where n — |m] is even. 
Ст] ай шана) pe [! туу |cos(m8) 
[55] 202 / | 16080 | он) 


1 ifm 20 


where €m = 
ue f otherwise. 


6.10.9.2 Tables of Zernike polynomials 


S » [C7" cos(m8) + 577 sin(m6)] Rẹ (r) 


(6.10.5) 


(6.10.6) 


| r dr dô 


6.10.10 SPHERICAL HARMONICS 


The spherical harmonics are defined by 


Yim (6, 9) == 
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(6.10.7) 


for | an integer and m = —l, —l + 1, ..., l — 1, l. They satisfy 


-m(8, 9) = (—1)'"У (Ө, 9), 


Yio(9, $) = ү (сов), (6.10.8) 


| i IEDC Pemi рт 
л 2) o QUE) т)! (т)! (-1 е Шт integral, 
0, 


Yin (F m EEFT 


~ 


ЗЭВ not integral. 


The normalization and orthogonality conditions are 


27 т 
| Фф | sin 040 Үр, (0, ф)Ү (0,0) = би Smm’, (6.10.9) 
0 0 


апа 


27 т 
| аф I sin 0 dB Үг ma (0, 8) Vis m, (0, d) Vigna (6, ф), 
0 0 


"n lL da 
1111 0 0 
where the terms on the right hand side are Clebsch-Gordan coefficients (see page 574). 

Because of the (distributional) completeness relation, 


n 


CE o). бюл 


4n (21, + 1) m2 Тїз 


со 


1 
У У Yu (6,0)Yis (0) = 6(ф- ф')8(сов Ө — соз Ө”), (6.10.11) 


120 т=—1 


an arbitrary function 0(0, Ф) can be expanded in spherical harmonics as 


00 1 
= У Аа). Am = | Ұһ(0-000,0 a0. 


ce (6.10.12) 
In spherical coordinates, 
1 d f 4d 
уь = [e (т) (050421 viste. (6.10.13) 
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6.10.10.1 Table of spherical harmonics 


1 
00 Nm 
3 
Yi; = —4/ — sin 0 et? 
1-1 A 
3 
Yio = 27 2080. 
2. 1 15 ND 21ф 
Tages әт іп Ве, 
15 Я 
122 Yo, = — ат sin 0 cos e*, 
1/5 
Vo — a4) = 20-1). 
20:25 27 9 COS 0-1) 
1 /35 ; 
Үзз = = i; біп? ae’, 
1 /105 
Ya -- sin? 0 cos 0 e”? , 
1-3 AV 27 


4; 45 cos? 0 — 1) е! 


1/7 
= — — 3 — . 
Үзо IN spe (5 сов” 6 — 3cos0) 


x 
— 
|| 
| 
4s | 
wary 
S 


6.11 GAMMA FUNCTION 
T(z) = = ей, z—r+iy, т> 0. 
0 
6.11.1 RECURSION FORMULA 


T(z +1) = 2Г(2). 


The relation Г(2) = Г(2--1)/2 can be used to extend the gamma function to the left 
half plane for all z except when z is a non-positive integer (i.e., z Z 0, —1, —2,.. .). 
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FIGURE 6.6 
Graphs of V (x) and 1/T (x) for x real. (From Тетте, М. M., Special Functions: An Intro- 


duction to the Classical Functions of Mathematical Physics, John Wiley & Sons, New York, 
1996. With permission.) 


IQ): 


- 1/1 (1) : 


6.11.2 GAMMA FUNCTION OF SPECIAL VALUES 
Tín+1)—n! ifn —0,1,2,..., where 0! = 1, 


r(1)-1, rQg)-i Г(3)-2, Г(1)- vm, 


1 1-3-5- (2m — 1) 
T Zl аа —12:3:5: 
Č + 5) 9m Мт, m , ‚З, , 
1 (-1)™2™ 
( т) а 
1) — 1) — 
T (4) = 3.62560 99082, Г (3) — 2.67893 85347, 
T (3) = ут = 1.77245 38509, Г (5) = 1.35411 79394, 
Г (2) = 1.22541 67024, Г (3) = ү/т/2 = 0.88622 69254. 
6.11.3 PROPERTIES 
1. Singular points: 
The gamma function has simple poles at z = —n (forn = 0,1,2,...), with 
the respective residues (— 1)" /n!; that is, 
: mo 
lim (z +n)T(2) = af 
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2. Definition by products: 


2 


nin 
Г = ]i — 
(2) nao z+ +n 
1 со 
e = ze П (а +z/n)e~*/"|, «is Euler’s constant. 


n=1 
3. Other integrals: 
TZ 59 
Г(2) сов > = | t^^! cost dt, 0<Rez <1, 
TZ гоо 
Г(2) sin 7r = | UC! sintdt, —1<Rez <1. 
0 
4. Derivative at x — 1: 
со 
Г) 2 Inte! dt = —. 
0 
5. Multiplication formula: 
1 
T(22) = 5-1/22?7-1T(z)T (: + 3) | 


6. Reflection formulae: 


Fees шоо 
T 
оаа 


= n Г(1 E) E ("т 
T(z — n) = (-1) Орау — SinzzF(n--1—z) 


6.11.4 ASYMPTOTIC EXPANSION 


For z > oo, |argz| < т: 


2т 1 1 139 
Шарты е И 2 ааа +... 
(2) gre | *12z 98821 5184077 * 


nieja т ac Y EN MENU (6.11.1) 
2 cn (2n — 1) z2n-1 


Mer жы d NE: NDS 
~ in --2%е — — —— —>— — — iu 
z 122 36023 12605 168027 : 


where B,, are the Bernoulli numbers. If we let z = n a large positive integer, then a 
useful approximation for n! is given by Stirling 5 formula, 


Г(п +1) = т! v VÄTNn e", n- oo. (6.11.2) 
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6.11.5 LOGARITHMIC DERIVATIVE OF THE GAMMA FUNCTION 


1. Definition: 


2. Special values: 
(1) = —y, víš) = —7— 22. 


3. Asymptotic expansion: 


For z + oo, [arg z| < т: 


] ы. 
90) m ma gr 7 0 2na 
т=1 
1 PNE iu 
slnz2——— —— + = — 25157 t... 
272271222 12024 25226 


6.11.6 NUMERICAL VALUES 


1.00000000 0.00000000 | —0.57721566 | 1.64493407 
0.97843820 | —0.02179765 | —0.51327488 | 1.55371164 
0.95972531 | —0.04110817 | —0.45279934 | 1.47145216 
0.94359019 | —0.05806333 | —0.39545533 | 1.39695222 
0.92980307 | —0.07278247 | —0.34095315 | 1.32920818 


0.91816874 | —0.08537409 | —0.28903990 | 1.26737721 
0.90852106 | —0.09593721 | —0.23949368 | 1.21074707 
0.90071848 | —0.10456253 | —0.19211390 | 1.15871230 
0.89464046 | —0.11133336 | —0.14674236 | 1.11075532 


0.89018453 | —0.11632650 | —0.10321006 | 1.06643142 


0.88726382 | —0.11961291 | —0.06138454 | 1.02535659 
0.88580506 | —0.12125837 | —0.02114267 | 0.98719773 
0.88574696 | —0.12132396 | 0.01762627 | 0.95166466 
0.88703878 | —0.11986657 | 0.05502211 | 0.91850353 
0.88963920 | —0.11693929 | 0.09113519 | 0.88749142 


0.89351535 | —0.11259177 | 0.12604745 | 0.85843189 
0.89864203 | —0.10687051 | 0.15933345 | 0.83115118 
0.90500103 | —0.09981920 | 0.19256120 | 0.80549511 
0.91258058 | —0.09147889 | 0.22429289 | 0.78132645 
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0.92137488 | —0.08188828 | 0.25508551 | 0.75852269 


0.93138377 | —0.07108387 | 0.28499143 | 0.73697414 
0.94261236 | —0.05910015 | 0.31405886 | 0.71658233 


0.95507085 | —0.04596975 | 0.34233226 | 0.69725865 
0.96877431 | —0.03172361 | 0.36985272 | 0.67892313 
0.98374254 | —0.01639106 | 0.39665832 | 0.66150345 


1.00000000 | 0.00000000 | 0.42278434 | 0.64493407 


6.12 BETA FUNCTION 


1 
B(p,q) = | 171(1—1)7!dt., Rep>0, Req»O0. (6.12.1) 
0 


1. Relations: 


B(p,q) = B(q.p), 
В(р,а +1) = 5 В(р+ 1,4) = —— B(p,q), 


ptq 
Г(р) Г(а) Г(ғ) 
В(р,4) B(p +q,r) = Та” 
2. Relation with the gamma function: 
Г(р) Г(а) 
В = ————. 
(p. q) T(p4 g) 


3. Other integrals (in all cases Re p > 0 and Re g > 0): 
7/2 
B(p,q) =2 | біп 2-10 сов2 211040 
0 
со 1р-1 
- | ЕЕ ану 
0 (t + Турға 
= ed 
i f e? (1 — et)! dt 
0 


1 ур-1 -1 
1071(1 — t) 

— 4 р EE 7. 

= еар f (рн dt, т> 0. 
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6.12.1 NUMERICAL VALUES OF THE BETA FUNCTION 
>]: =й 020 0300 848 0500 07 0700 0300 0900 1089 


17: 831 11.906 11. 323 10.914 10.607 1o. 365 1o. 166 [606 
7.748 6.838 6.269 5.872 5.576 5.345 5.157 
6.010 5.112 4.554 4.169 3.883 3.661 3.482 
5.112 4.226 3.679 3.303 3.027 2.813 2.641 
4.554 3.679 3.142 2.775 2.506 2.299 2.135 
4.169 3.303 2.775 2.415 2.154 1.954 1.796 
3.883 3.027 2.506 2.154 1.899 1.705 1.552 
3.661 2.813 2.299 1.954 1.705 1.517 1.369 
3.482 2.641 2.135 1.796 1.552 1.369 1.226 
3.333 2.500 2.000 1.667 1.429 1250 1.111 
3.099 2.279 1.791 1.468 1.239 1.069 0.938 
2.921 2.113 1.635 1.321 1.101 0.938 0.813 
2.779 1.982 1.513 1.208 0.994 0.837 0.718 
2.663 1.875 1.415 1.117 0.909 0.758 0.644 
2.564 1.786 1.333 1.042 0.840 0.694 0.585 
2.480 1.710 1.264 0.979 0.783 0.641 0.536 
2.406 1.644 1.205 0.925 0.734 0.597 0.495 
2.340 1.586 1.153 0.878 0.692 0.558 0.460 
2.282 1.534 1.107 0.837 0.655 0.525 0.430 
2.230 1.488 1.067 0.801 0.622 0.496 0.403 


6.13 ERROR FUNCTIONS 


2 22248 
2-2 / е” 

2 oo 
efes =- f F 

VT Je 


The function erf x is known as the error function. The function erfc x is known as 
the complementary error function. 


6.13.1 PROPERTIES 
1. Relationships: 


erf r 4- егїсх = 1, erf(—x) = — erf x, егіс(-а) = 2 — erfc x. 


2. Relationship with normal probability function: 


1 [ ETT žer (4). 
a e V t= -er Рачу 
м27 Jo /2 
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6.13.2 ERROR FUNCTION OF SPECIAL VALUES 
erf(too) = +1, erfe(—00) = 2, erfcoo = 0, 


1 
erf zo = егіс zo = 2 if zo s 0.476936. 


6.13.3 EXPANSIONS 


1. Series expansions: 


2. Asymptotic expansion: 


For z — оо, | arg | < ёт, 


mE n S co 
Мт 22 2-4 n22) 
2 е dodi. uf 15 
T 2z 222 4; 26 


6.13.4 SPECIAL CASES 


1. Dawson’s integral 
2 z sá 1 22 
F(x) = e” | ed -3ivme* erf (ix). 
0 


2. Plasma dispersion function 


w(z) = e^ erfc(—iz) 


© 2003 by СКС Press LLC 


FIGURE 6.7 

Cornus spiral, formed from Fresnel functions, is the set {x, y,t} where x = C(t), y = S(t), 
t > 0. (From Temme, N. M., Special Functions: An Introduction to the Classical Functions 
of Mathematical Physics, John Wiley & Sons, New York, 1996. With permission.) 


(0.5,0.5) e^ 


6.14 FRESNEL INTEGRALS 


2 [? 24f* 
= \/ 2| cost? dt, 5(2)-1/ 2| sin t? dt. 
T Jo T Jo 


6.14.1 PROPERTIES 


1. Relations: 


Ota S H erf 


у2 
2. Limits: i 
зе >> 
3. Representations: 
Ole) = 5 + Мә) sin(2?) — g(2) cos(z?), 
S() = 5 — F(2) cos(z?) — (е) sin(2?), 
where 
e оо Уе t 
=— | — dt, dt. 
Те) ud V +1) 44) --%/ (2+1) 


4. Cornus spiral: 


(2 еа =) оле 
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6.14.2 ASYMPTOTIC EXPANSION 


And for z — oo, | аг | < іт, 


1, x nl (2n + 1/2) 1 3 105 
f(z) ~ — ЖЫ? шан = V2nz | ET y 1624 © | , 


1 your 2201 1-19 " 945 — 
z2n43/2 БЕР lira 4 22 16 24 а 


6.14.3 NUMERICAL VALUES OF ERROR FUNCTIONS AND 


FRESNEL INTEGRALS 


0. Ar i sua 0. dura 0. €— 
0.22270259 | 0.80901952 | 0.15955138 | 0.00212745 
0.42839236 | 0.67078779 | 0.31833776 | 0.01699044 
0.60385609 | 0.56780472 | 0.47256350 | 0.05691807 
0.74210096 | 0.48910059 | 0.61265370 | 0.13223984 


0.84270079 | 0.42758358 | 0.72170592 | 0.24755829 
0.91031398 | 0.37853742 | 0.77709532 | 0.39584313 
0.95228512 | 0.33874354 | 0.75781398 | 0.55244498 
0.97634838 | 0.30595299 | 0.65866707 | 0.67442706 
0.98909050 | 0.27856010 | 0.50694827 | 0.71289443 


0.99532227 | 0.25539568 | 0.36819298 | 0.64211874 
0.99813715 | 0.23559296 | 0.32253723 | 0.49407286 
0.99931149 | 0.21849873 | 0.40704642 | 0.36532279 
0.99976397 | 0.20361325 | 0.55998756 | 0.36073841 
0.99992499 | 0.19054888 | 0.64079292 | 0.48940140 


0.99997791 | 0.17900115 | 0.56080398 | 0.61721360 
0.99999397 | 0.16872810 | 0.41390216 | 0.58920847 
0.99999848 | 0.15953536 | 0.39874249 | 0.44174492 
0.99999964 | 0.15126530 | 0.53845493 | 0.39648758 
0.99999992 | 0.14378884 | 0.60092662 | 0.52778933 


0.99999998 | 0.13699946 | 0.47431072 | 0.59612656 
1.00000000 | 0.13080849 | 0.41041217 | 0.46899697 
1.00000000 | 0.12514166 | 0.54218734 | 0.41991084 
1.00000000 | 0.11993626 | 0.56533023 | 0.55685845 
1.00000000 | 0.11513908 | 0.42894668 | 0.54293254 


1.00000000 | 0.11070464 | 0.48787989 | 0.42121705 
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FIGURE 6.8 
Sine and cosine integrals 512) and Ci(x), for 0 < т < 8. (From Тетте, М. M., Special 


Functions: An Introduction to the Classical Functions of Mathematical Physics, John Wiley 
& Sons, New York, 1996. With permission.) 


2- Si(x) 
л/2 Lr 


Ci(x) 


6.15 SINE, COSINE, AND EXPONENTIAL 
INTEGRALS 


6.15.1 SINE AND COSINE INTEGRALS 


TNT z —1 
Si(z) = 1 ын dt, Сі(2) 2 y+lnz + 1 e dt, 
0 0 


where y is Euler's constant. 


1. Alternative definitions: 


2. Limits: 


3. Representations: 


С) 
= 
жт- 
ә 
МУ 
II 
+ 
— 
лт 
ә 
МУ 
nm 
са. 
Нь) 
ә 
| 

© 
~ 
x 
МУ 
о 
o 
un 
m 


where 
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4. Asymptotic expansion: 


For z + oo, |argz| < т, 


6.15.2 EXPONENTIAL INTEGRALS 


00 2—21 
E,(z) = : dt, Rez>0, n=1,2,... 
y t 


n—1,—ž со —2t4n—1 
- | E. di, Rez SO. 
T(n) Jo 141 


1. Special case: 


% e 
FA(z) x ca Hh | arg | < т. 
2 
For real values of z = r, 
To 
Ei(z) = | € dt, 
Жаа 


where for x > 0 the integral should be interpreted as а Cauchy principal value 
integral. 


2. Representations: 


2 1 E —t 
Еу(2) = —y — In z + | ч dt, 
0 


F, (гез) = ү — In z — Ci(z) +i із w+ NO) : 


E\(a) = —Ei(—2), x>0 


6.15.3 LOGARITHMIC INTEGRAL 


li(z) = | £ = Ei(ln 2), 
o int 


where for x > 1 the integral should be interpreted as a Cauchy principal value 
integral. 
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6.15.4 E т 
7 Sm T бш Теш [єт p e 
0. a 0. Ae 
0.199556 E e Ыы ES —0.085126 
0.396461 | —0.378809 | 1.047828 0.070226 | —0.252949 
0.588129 | —0.022271 | 0.827933 0.422520 | —0.546851 
0.772096 0.198279 | 0.691245 0.605424 | —1.134012 


0.946083 | 0.337404 | 0.596347 | 0.697175 —00 

1.108047 | 0.420459 | 0.525935 0.735544 | —0.933787 
1.256227 | 0.462007 | 0.471293 0.741568 | —0.144991 
1.389180 | 0.471733 | 0.427488 0.727902 | 0.353748 
1.505817 | 0.456811 | 0.391492 0.702498 | 0.732637 


1.605413 | 0.422981 | 0.361329 0.670483 1.045164 
1.687625 | 0.375075 | 0.335651 0.635192 1.315238 
1.752486 | 0.317292 | 0.313502 0.598799 1.555671 
1.800394 | 0.253337 | 0.294186 0.562705 1.774145 
1.832097 | 0.186488 | 0.277179 0.527789 1.975643 


1.848653 | 0.119630 | 0.262084 | 0.494576 | 2.163589 
1.851401 0.055257 | 0.248588 0.463356 | 2.340436 
1.841914 | —0.004518 | 0.236446 0.434256 | 2.508008 
1.821948 | —0.057974 | 0.225460 0.407294 | 2.667700 
1.793390 | —0.103778 | 0.215471 0.382424 | 2.820603 


1.758203 | —0.140982 | 0.206346 0.359552 | 2.967585 
1.718369 | —0.169013 | 0.197976 0.338561 3.109354 
1.675834 | —0.187660 | 0.190270 0.319321 3.246490 
1.632460 | 0.197047 | 0.183151 0.301697 | 3.379479 
1.589975 | —0.197604 | 0.176554 | 0.285555 | 3.508729 


1.549931 | 0.190030 | 0.170422 0.270766 | 3.634588 


6.16 POLYLOGARITHMS 


* dt 


Lii(z) = qup — In(1 — z), logarithm, 
NIS 
* Li * In(1 — 
Lig(z) = 14) dt — — Bp dt, dilogarithm, 
t t 5 
0 0 
514, 
Lin (2) = | Hoi di, n22, polylogarithm, 
0 


PONENS 


co j4rv—1 
EE : dt, Rev >0, z ¢ {Re z є |, оо], Im z = 01. 
0 
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6.16.1 POLYLOGARITHMS OF SPECIAL VALUES 


2 
р T 
Lig(—1) = 719: 


Li,(1) = ¢(v), Rev>1 (Riemann zeta function). 


6.16.2 POLYLOGARITHM PROPERTIES 


1. Definition: For any complex v 


Li,(z) = > — 12|<1 
k=1 
2. Singular points: 
z = Lisa singular point of Li, (z). 
3. Generating function: 
ы озеш] 
Sow"! Lin (z) = z | 7 dt, #ё[1,оо). 
nz 0 gt 


The series converges for |w| « 1; the integral is defined for Re w « 1. 
4. Functional equations for dilogarithms: 


1 
Lig(z) + Lis(1— z) = 57 — In z In(1 — z), 


5 14: (42) = 145(ш) + Lig(—z), 


Li»(—1/z) + Li>(—1) — -iq — 5 (In x)“, 
Li (—ry/z) + Lig(—yz/x) + Lix(—2z/y), 


where 1/2 + 1/y 4- 1/z = 1. 


6.17 HYPERGEOMETRIC FUNCTIONS 


Recall the geometric series and binomial expansion (|z| < 1), 


U- o Sew 


n=0 
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where the shifted factorial, (a)n, is defined in Section 1.2.6. 
The Gauss hypergeometric function, Е, is defined by: 


= a)n (b)n % 
Pb Y s 


1 1 (6.17.1) 
=1+®, A мы Б |z| « 1, 
c(c + 1) 2! 


= F (b,a; c; 2) 


where а, b and c may all assume complex values, c Z 0, —1, —2,.... 


6.17.1 SPECIAL CASES 
1. F(a,b;b;z) = (1 — 2)" 
2. F(1,1:2: z) — S 


2 
1 8 1 1-2 
. Е[—,1 21---1 
3 2222) x" 


2 
1 —1 
4. ғ(5 lži 59 BE 


2? z 

113 , sin“) z 
i ғ(5 2 #) = 2 
6. F 113. E Қаға 4-22) 
i 2/255 i z 


7. Polynomial case; for m — 0,1,2,... 


F(-m,b;c;z) = V (ст 9а л. Уан 0 (Ул ул, (6.17.2) 


24 (бат! 


6.17.2 PROPERTIES 


1. Derivatives: 


L Fiabe) = Č Pla + 1,b+ lic + 1: z), 


“Fla, bici z) = Oe Fla к/р яле Ж). 
n C)n 


2. Special values; when Re (c — a — b) > 0: 


r(e) (c-a — b) 


Ғ(а,6 с; 1) = Tle- oi (eb) 


3. Integral, when Re c > Re b > 0: 


F(a,b: c: z) = Oreo 2-0) | jg ges bd 
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4. Functional relationships: 


F(a, b; c; z) = (1 — 2) “Е(а,с- b; c; —) 
_ 2 
-(1-2) “Е(ес-а,5с; 1) 


= (1 — z) 727% F(c— a, c — b; c; z). 


5. Differential eguation: 


z(1— z)F" +[c— (a - b -- ДЕ — abF = 0, 


with (regular) singular points z = 0,1, оо. 


6.17.3 RECURSION FORMULAE 


Notation: Р is F (а, b; с; 2); F(a+), F(a—) are F (a + 1,b;c; 2), 
F (a — 1,b; с; z), respectively, etc. 


9500 LAN duc au ы-ы 


(c — a)F(a—) + (2a — c — az +bz)F + a(z — 1)F(a 
c(c—1)(2—1)P(c—)+ele—1—(2c—a—b—1)2]F + (c— 
cla + (b — c)z]F — ac(1 — 2) Е(а+) + (c — a)(c — b 
c(1— z)F — cF(a—) + (c — b)zF(c+) = 0 

(b — a)F +aF(a+) —bF (b+) = 0 

(c— a — b)F +a(1 — z)F(a+) — (c — b)F(b—) = 0 
(c—a—1)F +aF(a+) — (c— 1)F(c-) = 0 

(b —a)(1— z)F —(c—a)F(a—) + (c— b)F(b—) = 0 
la—1+(6+1— e)z]F +(c— a)F(a—) – (c— 1)(1 — z)F(c0—) = 0 


T 
a)(c— ПЕТЕ = 0 
Е(с+) = 0 


)z 


6.18 LEGENDRE FUNCTIONS 


6.18.1 DIFFERENTIAL EQUATION: LEGENDRE FUNCTION 


The Legendre differential equation is, 


(1 — 27)w" – 2zw' + v(v + 1)w = 0. 


The solutions Р,(2),0,(2) сап be given in terms of Gaussian hypergeometric 
functions. 
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FIGURE 6.9 

Legendre functions P, (x), n = 1,2,3 (left) and Qn (x), n = 0,1,2, 3 (right) on the interval 
[—1,1]. (From Тетте, №. M., Special Functions: An Introduction to the Classical Functions 
of Mathematical Physics, John Wiley & Sons, New York, 1996. With permission.) 


6.18.2 DEFINITION 


1 1 
Bla) = Fl -nv+U515- 32). 


VTI +1) к( AE NE: |: 


Q6) = p Зу бау —v+1,-v0 + 


2 2 2 2 


The Q, function is not defined if v = —1, —2,.... 


6.18.3 SINGULAR POINTS 


B, (z) has a singular point at z = —1 and is analytic in the remaining part of the 
complex plane, with a branch cut along (—oo, —1]. Q(z) has singular points at 
z = +1 and is analytic in the remaining part of the complex z— plane, with a branch 
cut along (—oo, +1]. 


6.18.4 RELATIONSHIPS 
Р_,„_1(2) = Р, (2), 
О—ь„—1() = 0,(2) ^ TcotvrP, (z). 
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6.18.55 RECURSION RELATIONSHIPS 
(v +1)B,41(2) = (2v + D)zP,(z) — vB, (z), 
(2v 4-1)Р,(2) = Pryi(z) — Pj); 
(v + 1)P,(2) = Pras (2) — 2Р,(а), 
vP, (2) = 2P,(2) - Pp (2), 
(1 — 2?)P/ (2) = vP,-1(z) — vzP, (2). 


The functions Q, (z) satisfy the same relations. 


6.18.6 INTEGRALS 
Кот + 5)0 — +3)0 
V 2 cosh a — 2 cosh 0 


ET. е—(#+1/2)9 


а V2 V cosha — 2coshd a — 2cosh 0 


P,(cosh а) = 


(6.18.1) 


Tas 
o (cosha + sinha cos ý)"/+! 
(cosha + sinha cosy)” 40. 


Y 
T 
o 
un 
© 
| 
Ale Ale A [© Ale Ale 


2 Bee Сш: 


5—+ 


P — cos(v + 1)8 
V2 cos0 — 2cos B 


ар 
(cos 8 + isin В cosy)” t! (6.18.2) 


(cos 8 + isin 8 cosy)” dy). 


3 


—v—1 : a-e) 
Q,(z) =2 (20711 Re v > —1, | arg z| «T, z¢ ЕҢ 
-1 EX 


=f [+ 


—v—1 
— 1 cosh B dó 


oo е-(у1/2)0 


= & V2 1/2 cosh — 2 созһ a ына: 


z = cosh a. 


6.18.7 POLYNOMIAL CASE 


Legendre polynomials are special cases (see Section 6.10.5) when v = п = 0, 1,..., 


(6.18.3) 


1 
Pule) = F (nnti - 5) (6.18.4) 
ui (—1)* = — 2k)! m in, if n even, 
= =», 2^ k! ( 2k" ккк Ас) 
= (n — k)! (n — 2k)! l(n—1), ifn odd. 
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1 
: : 2 

The Legendre polynomials satisfy | 1 Р,(2)Р,,(2) dz = mar" 
The Legendre series representation is 

00 1 

2 1 
= VAYP, (r), А = - / f(x) P, (в) dz. (6.18.5) 
-1 


For integer order, we distinguish two cases: Qn(x) (defined for x € (—1,1)) 
and Q(z) (defined for Re z ¢ [—1, 1]: 


1, 1+: 1 1-2 
Qo(x) = 2 In 1 01(4) = ;zln үсэг 1, (6.18.6) 
ii 1. 2+1 io. d 
2 2 
Qo(z) 2 In — D Qi(z) 5218 ur 1. (6.18.7) 
In both cases 
— (2k + 1)[1 — (-1)*** 
Qn(y) = 2 ШЕ а (6.18.8) 


(n+k+1)(n —k) 


> x(5a“ — 3) 
+ (3524 — 3027 + 3) P,(x)Qo(a КЕТ 
iz(63z* — 7022 + 15) | P5(z)Qo(z) – Ë rt + Br? — È 


6.18.8 DIFFERENTIAL EQUATION: ASSOCIATED LEGENDRE 
FUNCTION 


The associated Legendre differential equation is 


1 — 22)" — 22y + vv +1) - 155 y = 0 

1- 22 
The solutions Р (z), Q” (2), the associated Legendre functions, can be given in 
terms of Gauss hypergeometric functions. We only consider integer values of ji, v, 
and replace them with m,n, respectively. Then the associated differential equation 
follows from the Legendre differential equation after it has been differentiated m 
times. 
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6.18.9 RELATIONSHIPS BETWEEN THE ASSOCIATED AND 


ORDINARY LEGENDRE FUNCTIONS 


The following relationships are for z £ [—1, 1] 


Pz) = G^ - 0$" 4— P2), 
--1)т 1 т--т 
= = (2? = yn A сы 1)”, 
—m (n =з m)! m 
RO = (2-1) T Qu), 
Өк") = AO) 
кедр ЇГ f no), 


PPS (2) = Py (2). 


6.18.10 ORTHOGONALITY RELATIONSHIP 


Let n > m, then 


| ВР) =] 3 mim) 


2n+1 (n-m)! 


6.18.11 RECURSION RELATIONSHIPS 


m+1 2mz m 
prit OI a (z) 
2 dP,” (z) 
(z^ — 1) PE 
(2n + 1)z P?" (z) 
АРТ (2) 

dz 


Piil) — РА 2) 


(25:54) 


= (n — m * 1)(n +т)Р"—1(), 


= mzP™(z) + V 22 — 1PI^ (2), 
= (n —т+1)Р (2) + (n + m Pulz), 


=(n-—mt+1)P™ (2) — (n + DzP7" (z), 


= —(2п+ 1/22 — 1P?-Y(2). 


The functions ()' (2) satisfy the same relations. 
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6.19 BESSEL FUNCTIONS 


6.19.1 DIFFERENTIAL EGUATION 


The Bessel differential eguation 1s 
22у" + гу' + (22 — „?)у = 0. 
The solutions are denoted with 
Ј,(2), V (z) (the ordinary Bessel functions) 


and 
H(z), НО) (z) (the Hankel functions). 


Further solutions are 
К. WG) BG) HOG). 


When v is an integer, 


Bessel functions Jo(x), Ji (2), Yo(x), Yı (2), 0 € z < 12. 


6.19.2 SINGULAR POINTS 


The Bessel differential equation has a regular singularity at z = 0 and an irregular 
singularity at z = oo. 
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6.19.3 RELATIONSHIPS 
H(z) -4,(2) +i¥,(z), HP (2) = JL(2) — iY, (@). 
Neumann function: If v Z 0, +1, +2,... 


соѕит J,(z) — I (2) 
sin VT : 


Ү,(2) = 


When v = n (integer) then the limit v — n should be taken in the right-hand side of 
this equation. Complete solutions to Bessel's equation may be written as 


с14,(2) + e3J (2), if v is not an integer, 
с147,(2) + с2Ү,(2), for any value of v, 
ci HO? (2) + cH?) (ғ), for any value of v. 


6.19.4 SERIES EXPANSIONS 


For any complex z, 


(3 j^ c ( )" (52) 
dur = Age [з= ni 
AG) = 1-64 gru G2 - gr ess 
1 1 1 2 1 1. 4 1 1 
лә «045 gg 2 * gg! - gs. 
Y,(2) = ЛЕГЕН ш зугт үз 
k—0 
1 2)" k 1; 2k 
22 Ум (k +1) TE 


where % is the logarithmic derivative of the gamma function. 


6.19.5 RECURRENCE RELATIONSHIPS 


Ca) + Con) = 2,0), 
Cy) — Cry (e) = 20% (2), 
C5) = Cyn) - 20.0), 
€) = О, (2) + 203). 


where C',(z) denotes one of the functions J,(z), Ү, (z), HY (z), HY? (z). 
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6.19.6 BEHAVIOR AS z > 0 
Let Re v > 0, then 


269) S Үд) ~ -Lr() (2). 
ноо) = д0 (2). не ~ ато (2) 


The same relations hold as Re v — оо, with z fixed. 


6.19.7 INTEGRALS 


Let Re z > 0 and v be any complex number. 


1 [Т i oo | 
7,(2) = 2| соѕ(и0 — z sin Ө) 10 — =н” | e-t- zsinht gy 
9 0 


2)” 1 цаа 
=f | 8-9) 2 cosztdt, Rev > —3, z complex, 2 7 0, 
5) /- 
2(1x) " [9 аша! 
xD a ааа 
yat wd usce 


RE oo | 
Ү,(2) = л | sin(z sin Ө — v0) d0 — | (e"* + е соз ит) e ^simht dt 
0 0 


zíde“ „po t 
SR uus p re ee 
Val (3 - v) Ji (02 —1)"t2 


When v = n (an integer), the second integral in the first relation disappears. 


6.19.8 FOURIER EXPANSION 


For any complex z, 


со 
e sint = 5 gm. 
n-—-—oo 
with Parseval relation m 
5 J2(z) 21 
n—— 00 


6.19.9 AUXILIARY FUNCTIONS 
Let x = z — ($v + 3)r and define 


P(v,z) = v 12/2] J(z)cosy + Y,(z) sin x], 
Q(v,z) = V 72/2[—Jy(z) sin x + Y, (z) cos x]. 
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6.19.10 INVERSE RELATIONSHIPS 


Ј,(2) = V 2/ (rz) [P(v, z) cosy — Q(v, z) sin x], 
Y,(z) = V 2/(7z) [P(v, z) sin x + Q(v, z) cos x]. 
For the Hankel functions, 
H(z) = 2/(тг) [P(v, z) + iQ(v, z)]e'*, 
HO) (2) = \/2/(т=) [P(v, z) — iQ(v, z)Je~™. 


The functions P(v, 2), (р, z) are the slowly varying components in the asymptotic 
expansions of the oscillatory Bessel and Hankel functions. 


6.19.11 ASYMPTOTIC EXPANSIONS 
Let (a, n) be defined by 


(amy — fa? — 1)(4a? — 32)... (4a? — (2n — 1)2)) 
Ш Г(5 +а+л) Е 
аг п =0,1,2,..., 


= (CUP costa нү -а-т)Г(3-а-зп), 


with recursion 


(a,n +1) = — RT (an), n21,2,3,..., (o,0) — 1. 
Then, for z — оо, 
рог) ~ Vo) обоз) У)" 6228 D. 
2 = (22)2"' ; a (22)2п+1 
With u = 417, 
(p—1)(9—9)  (4—1)(4—9)(u — 25)(и — 49) 
БЕ = = TECH амлана -..., 
n—1 (u—1)(u—9)(u— 25) 
Әб 7 3E 


For large positive values of т, 
1 1 E 
Jy (a) = J2/ (x) cos(r — 5 vm — 77) + O(z |, 


Y, (x) = V 2/(71) — — — 17) + 0277) 1 
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6.19.12 ZEROS OF BESSEL FUNCTIONS 


For v > 0, the zeros j,,, (and у, в) of Jy (x) (and Ү, (1:)) can be arranged as se- 
guences 


0< jv] < 32 << Jun <, lim jun = oo, 
noo 

0 < yo <уь2 X X un Xo, lim yos = 00. 
noo 


Between two consecutive positive zeros of J, (x), there is exactly one zero of Jj 4 (2). 
Conversely, between two consecutive positive zeros of J ,. р (2), there is exactly one 
zero of J,(x). The same holds for the zeros of Y,(z). Moreover, between each 
pair of consecutive positive zeros of J, (x), there is exactly one zero of Y, (x), and 
conversely. 


6.19.12.1 Asymptotic expansions of the zeros 
When v is fixed, s >> v, and и = 4v?, 


p-1[, 4(7z2-—31) 32(83,2 — 982и + 3779) 
8a 3(8a)? 15(8a)4 


Jvs ^ € — 


where a = (s + iv x: im; Уу, has the same asymptotic expansion with a = 
(s + iv — “т. 


2.40483 | 3.83171| 0.89358 | 2.19714 
5.52008 | 7.01559 | 3.95768 | 5.42968 
8.65373 | 10.17347 | 7.08605 | 8.59601 


11.79153 | 13.32369 | 10.22235 | 11.74915 
14.93092 | 16.47063 | 13.36110 | 14.89744 
18.07106 | 19.61586 | 16.50092 | 18.04340 
21.21164 | 22.76008 | 19.64131 | 21.18807 


Positive zeros jv, n, y», of Bessel functions J,(z), V (£), v = 0,1. 


6.19.13 HALF ORDER BESSEL FUNCTIONS 


For integer values of n, let 


jnl2) = Vn) Inga (8), за (2) = М7 22) Ynys (2). 


Then : 
А sin z | соз 2 
jo(z) = y-1(z) = 23 yo(z) = —j-1(z) = — 2 
and, for = 0,1,2,..., 
n [ld ]^ sing "|141" cosz 
jn(z) = (-2)* |-—- ‚ Yn(z) = —(—2)" |——— 
zdz z z dz z 
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6.19.13.1 Recursion relationships 

The functions jn (2), ул (z) both satisfy 
zlfn- (2) + fnti(2)] = @п + 1) (2), 
nfn—1(z) — (n +1)Һһ+1(®) = Qn + 1) f (2). 


6.19.13.2 Differential eguation 
z^ f" +22f +1 — n(n + 1)]f = 0. 


6.19.14 MODIFIED BESSEL FUNCTIONS 


1. Differential eguation 


БЕТА $ zy = (г? + vy = 0. 
2. Solutions 1,(2), К,(2), 
со 
zy” (2/2)°" 
1,(2) = {= ET ТЕКСТТІ 
(2) (5) Э.гбухагЕТИЙ 


nID 2) — (z) 
2 sin vr 1 


К,(2)- 


where the right-hand side should be determined by |’ Hôspitaľs rule when v 
assumes integer values. When n = 0,1,2,..., 


k=0 

CD” (z^ х= (;/2)* 
+ (2) k 1) +ф(п+Е+ D]— _. 
27-79 208 аяа EV a + By 

3. Relations with the ordinary Bessel functions 
I (z2) = e73" J, (гез) 1 -т < аге 2 < 2 
I (z) ser" J, (26%) : 5 « argz X m, 
K,(z) = ier (zei7*) Я -т < argz < > 
K,(z) = ТН (ze-#**) ; -т <argz <7, 
iri 4(v+1)ri РРР T 
Y, (ze? ) =e? Ip (z) — —e72”"'K,(z), —т < агре < 2. 
T 


For n —0,1,2,..., 
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4. Recursion relationships 


Les 1 00038 cos(vé) dg — ST | ети seht dy 
7T Jo T 0 


22 (2z)"e* ! е2 ЭР и– 5 
шс тг І EO- A] dt, 


Rev > —1 


5: 2 complex, z Z 0. 


oo 
хи 1 e-z 995! cosh(vt) di 
0 


2)“ „—# роо 
Sl г А ctn F(t + 1)"73 dt, 
2 


Rev > —i, Re z > 0. 
T (v + 3) (22)" ТЕ cos at dt 
о ( 


, 


#2 + азу 


Re v > —4 


1, x 0, largz| < 4r. 


When v — n (an integer), the second integral in the first relation disappears. 


6.19.15 AIRY FUNCTIONS 


1. Differential eguation 
y" — zy = 0. 


2. Solutions are Ai(z) and Bi(z): 


Ai(z) = a f(z) — eag(z), 
Bi(z) = V3 [c1 f(z) + с20(2)] 


la L 
Ка) =1+ 37 Tee + 0! 

2 2.5 2.5.8 
0(2) = 2+ 2 + 27 + 101 E 


сол Ai(0) = Bi(0)/V3 -3-7/2Г(2) = 0.35502 80538 87817, 
c» = — Ai’ (0) = Bi/(0)/V3 = 37! ?T (1) = 0.25881 94037 92807 . 
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FIGURE 6.10 
Graphs of the Airy functions Ai(x) and Bi(z), x real. 


3. Wronskian relation 


Ai(z) Bi (z) — Ai (z) Bi(z) = 1 


4. Relations with the Bessel functions 


Let ¢ = 22%, then 


AC) = gv? [0 - 140] = ука) 
Ai(—2) = 2V2 [O 4-40] 

НО ТЕ [0+ 1 ()] 
Bi(—z) = ТЕ [7-30 -л (| 


5. Integrals for real x 


1 со 
Аца) = = І cos (1 + zt) dt, 
: Iq -448--а1 1,5 5855 143 
Bi(z) = — e 3 dt + — sin (31 + xt) dt. 
T Jo T Jo 
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6. да behavior 


Гес = 228. Then, for z — oo, 
— 
Bi(z) = ын [1+0 (6), 


arg z 


A 


arg z 


A 


arg z 


A 
VIN wire we 


arg z 


«T, 


а 


а 


A 


6.19.16 NUMERICAL VALUES FOR THE BESSEL FUNCTIONS 


1. RU 
0.99002497 
0.96039823 
0.91200486 
0.84628735 


0.76519769 
0.67113274 
0.56685512 
0.45540217 
0.33998641 


0.22389078 
0.11036227 
0.00250768 


—0.09680495 
—0.18503603 


—0.26005195 
—0.32018817 
—0.36429560 
—0.39176898 
—0.40255641 


—0.39714981 
—0.37655705 
—0.34225679 
—0.29613782 
—0.24042533 


—0.17759677 
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0. ss 
0.09950083 
0.19602658 
0.286 70099 
0.36884205 


0.44005059 
0.49828906 
0.54194771 
0.56989594 
0.58151695 


0.57672481 
0.55596305 
0.52018527 
0.47081827 
0.40970925 


0.33905896 
0.26134325 
0.17922585 
0.09546555 
0.01282100 


—0.06604333 
—0.13864694 
—0.20277552 
—0.25655284 
—0.29849986 


—0.32757914 


— 10811 10532 
-0.60602457 
—0.30850987 
—0.08680228 


0.08825696 
0.22808350 
0.33789513 
0.42042690 
0.47743171 


0.51037567 
0.52078429 
0.51041475 
0.48133059 
0.43591599 


0.37685001 
0.30705325 
0.22961534 
0.14771001 
0.06450325 


—0.01694074 
—0.09375120 
—0.16333646 
—0.22345995 
—0.27230379 


—0.30851763 


_3.323824909 
—1.78087204 
—1.26039135 
—0.97814418 


—0.78121282 
—0.62113638 
—0.47914697 
—0.34757801 
—0.22366487 


—0.10703243 
0.00148779 
0.10048894 
0.18836354 
0.26354539 


0.32467442 
0.37071134 
0.40101529 
0.41539176 
0.41411469 


0.39792571 
0.36801281 
0.32597067 
0.27374524 
0.21356517 


0.14786314 


: 1.00000000 | 0.00000000 00 00 
0.82693855 | 0.08228312 | 2.14075732 | 5.83338603 
0.69740217 | 0.13676322 | 1.66268209 | 3.25867388 
0.59932720 | 0.17216442 | 1.41673762 | 2.37392004 
0.52414894 | 0.19449869 | 1.25820312 | 1.91793030 


0.46575961 | 0.20791042 | 1.14446308 | 1.63615349 
0.41978208 | 0.21525686 | 1.05748453 | 1.44289755 
0.38306252 | 0.21850759 | 0.98807000 | 1.30105374 
0.35331500 | 0.21901949 | 0.93094598 | 1.19186757 
0.32887195 | 0.21772628 | 0.88283353 | 1.10480537 


0.30850832 | 0.21526929 | 0.84156822 | 1.03347685 
0.29131733 | 0.21208773 | 0.80565398 | 0.97377017 
0.27662232 | 0.20848109 | 0.77401814 | 0.92291367 
0.26391400 | 0.20465225 | 0.74586824 | 0.87896728 


0.25280553 | 0.20073741 | 0.72060413 | 0.84053006 


0.24300035 | 0.19682671 | 0.69776160 | 0.80656348 
0.23426883 | 0.19297862 | 0.67697511 | 0.77628028 
0.22643140 | 0.18922985 | 0.65795227 | 0.74907206 
0.21934622 | 0.18560225 | 0.64045596 | 0.72446066 
0.21290013 | 0.18210758 | 0.62429158 | 0.70206469 


0.20700192 | 0.17875084 | 0.60929767 | 0.68157595 
0.20157738 | 0.17553253 | 0.59533899 | 0.66274241 
0.19656556 | 0.17245023 | 0.58230127 | 0.64535587 
0.19191592 | 0.16949973 | 0.57008720 | 0.62924264 
0.18758620 | 0.16667571 | 0.55861332 | 0.61425660 


0.18354081 | 0.16397227 | 0.54780756 | 0.60027386 


6.20 ELLIPTIC INTEGRALS 


6.20.1 DEFINITIONS 


Any integral of the type f R(z,y) dz, where R(x, у) is a rational function of 2 
and y, with y? being a polynomial of the third or fourth degree in т (that is y? = 
aoz + asr? + azz’? + азх + a4 with [ao| + [a1| > 0) is called an elliptic integral. 
АП elliptic integrals can be reduced to three basic types. 
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1. Elliptic integral of the first kind 


Ш 4 40 
1 — k? ч 9 


, g=sing, k <1. 
oo TF 


2. Elliptic integral of the second kind 


ф 
вю = | V1—k? sin? 0 d0 


v1 — ket? ket? a 
-[ +55 t, т-віпф, k «1. 
1 — NIE 
3. Elliptic integral of the third kind 
: 1 40 

II(n; 9, k) = | So 

o 1+nsin“ 6/1 — k? sin? 9 

A owl dt 

xi — t, s-sné, 0 <1, 
o lc nt^ 4/(1—12)(1 — k?t?) 


where for n « —1 the integral should be interpreted as a Cauchy principal 
value integral. 


6.20.2 PROPERTIES 
1. The complete elliptic integrals of the first and second kinds are 
т/2 
_ = T = o pan AT 4, 1 1.22 
к=к) =F (5.4) = f (1 — k? sin? t) a-5r (5.58). 
7/2 -1/2 
К(а) zi (1 — sin“ a sin“ t) dt, 
0 
т/2 
pen ie а lique 
B-B() =E (5.4) = | (1 — k? sin? t) 4-57 ( 22-148), 
т/2 1/2 
Е(а) = (1 — sin“ asin? t) ^^ dt, 
0 


where F (+3 25 i 1; К?) 1s the Gauss hypergeometric function. 
2. Complementary integrals 


In these expressions, primes do not mean derivatives. 


—1/2 


а-Е(5.8) 


т/2 
Е = E'(k) = E(k’) 1 (1 — (1 — Es? t)? dt = E (55) 
0 


т/2 
K = K'(k) = K(k’) І (1 — (1 — k“) sin’ t) 
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k is called the modulus; k" = V1 — k? is called the complementary modulus. 


3. The Legendre relation is 


KE+EK -KK = T 
4. Extension of the range of ф 


Fín,k) = 2K, B(n,k) = 2E, 
and, for m = 0,1,2,..., 


Е(ф+тт,Е) = тЕ(т, k) + Flo, k) = 2mK + Е(ф, К), 
Е(ф + mr,k) = тЕ(т, k) + Е(ф, k) = 2m E + Е(ф, К). 


6.20.3 NUMERICAL VALUES OF THE ELLIPTIC INTEGRALS 


д 
Е(ф,а) = | (1 — sin? a віп? 0) 77? dt (note that k = sin a) 
0 
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a | K(a) K'(a) Ela) Ea) k | К(К) K'(k) E(k) E'(k) 


K(k 
20 F 
T/2 = 
E(k) 
10 Г 
05Г 
k > 
0 1 1 1 1 
0.5 1.0 


The complete elliptic integrals E(k) and K(k), 0 < k < 1.! 


!From Тетте, N.M., Special Functions: An Introduction to the Classical Functions of Mathematical 
Physics, John Wiley & Sons, New York, 1996. With permission. 
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6.21 JACOBIAN ELLIPTIC FUNCTIONS 


The Jacobian Elliptic functions are the inverses of elliptic integrals. If u = F (¢, k) 
(the elliptic integral of the first kind) 


? 40 4 dt 
u= | —— - | -———————==, (6.21.1) 
o V1—k?sin?6 Jo V(1-B8)( — kt?) 
with k? < 1, then the inverse function is 
ф = әти (the amplitude of и). (6.21.2) 


(Note that the parameter Ё is not always explicitly written.) The Jacobian elliptic 
functions are then defined as 


1. snu — sn(u,k) = sing = sin(am u) 
2. cnu = cn(u,k) = cos ó = coslam u) = V1 — sn? u 
3. dnu = dn(u,k) = V1 — k? sin? ф = V1 А sn? u 


Note that 


cn(u,k) dt 
"e _. 
1 (1 — (E? +?) 


БЭР p (6.21.3) 
UM _ 
t (1 - 8) — k?) 
6.21.1 PROPERTIES 
]. Relationships 
sn?(u, k) + en?(u, k) = 1, 
dn? (и, k) + К? sn?(u,k) = 1, 
ап? (и, k) — К cn? (uk) =1—k? = k“. 
2. Special values 
(a) sn(0, k) — 0, (e) sn(u,0) = sinu, (h) sn(u, 1) = tanh u, 
(b) cn(0,k) = 1, (f) cn(u, 0) = сози, (1) cn(u, 1) = sech u, 
(c) dn(0, k) = 1, (g) dn(u,0) = 1, (j) dn(u,1) = sech u. 
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3. Symmetry properties 


(a) sn(—u) — — sn(u), (c) dn(—u) — dn(u), 
(b) cn(—u) = cn(u), (d) am(—u) = — am(u). 


4. Addition formulae 


Он рг ѕписпо апо tcnusnvudnu 


^ 


1—k? sn? u sn? v 


12302222 cnucnu Fsnudnusnudnv 


^ 


1— k?sn?usn?v 
dn u dno x k?snucnusnvcno 


(c) dn(u+v) = 1 — k? sn? usn? v 


5. The elliptic functions are doubly periodic functions with respect to the vari- 
able u. The periods of 


sn(u,k) are АК and 2K, 
cn(u,k) are АК and 2K +2iK', 
dn(u,k) are 2K and 44К”. 


6.21.2 DERIVATIVES AND INTEGRALS 


1. EE 4. | nudu = ибен]. 
du k 

2. nd = —snu dnu. 5 | vu du = Зи dan 
ди 7 "k à 

3. “ас ЛИГ = — 
di 6. ана = ати sin (sn u). 


6.21.3 SERIES EXPANSIONS 
3 5 
snu, k) = u — (1+ k?) Er + (1 +14 + RT 


7 
— (1 + 135k? + 135k“ +) +... 


(6.21.4) 


2 6 
ыг @ +447 + 16K) T+... 


4 
a + + АЁ?) 


и 
cn(u,k) = 1 — ap. 


21. зи? 2 2 ut 2 2 4 uo 
dn(u,k) 21—k z ++) к (16 + 44k ur dus 


© 2003 by СКС Press LLC 


Let the nome g be defined by q = єе-*К/К' and = ru/(2K). Then 


27 < дез 
sn(u, k) reri kK >, 1- qn sin[(2n + 1)v], 
в 


en(u,k) = DY соз[(2п + 1)v], (6.21.5) 
n=0 


2 со 


cos(2nv). 


6.22 CLEBSCH-GORDAN COEFFICIENTS 


These coefficients arise in the integration of three spherical harmonic functions (see 
equation 6.10.10 on page 539). 
2 c (ji + j2 — ING + - j2)(J + j2 — 4) (23 +1) 
my анаан, (+j + +1) 
XY (—1)* тл (01 — та)!(72 + ma)!(j — m2)! + m) — т)! 
iG j j— k)(j1 — mi — k)!(jo + ma — k)!(j — jo - mi + К)!(3 


1. Conditions: 


(a) Each of (51, j2, j, m4, m», m] may be an integer, or half an integer. Ad- 
ditionally: j > 0, jı > 0, j2 > 0 and j + jı + Jo is an integer. 

b) jı +j2 -j >O. 

(с) ji — j2 +j > 0. 

(д -jı + j2 +j > 0. 

(e) [mi| < ji. [m2] <р, [m] < j. 


2. Special values: 


л Ug а 
(a) Са us A) = if m; +m # m. 
А 017 
(b) Ён 0 | = бу „jÔma m: 
(c) e | | = 0 when 7; + j» + j is an odd integer. 
л jii be it | 
(а) 2 mi A) = 0 when 27, + 7 is an odd integer. 
3. Symmetry relations: all of the following are equal to Л [Jj i 
my, Malm 


(a) ( a 


-m2 —T 
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m1 ms 


(c) cate ( л j2 


-mı —Tn» 


(b) (—1)/1+273 2 л 


(а) 27-1 (—1)/2+m2 | 7 ja 


21141 -m mo» 


I Be " j ja 
о (Bye (i А 


© VO (A i|), 


1112 — | -mı 
SERE av uu f J1 j j2 
(B 4/52 0-1) e 21. 
BEE an pes 227 
(h) Všimol) 1 -mı | тэ)? 


By use of the symmetry relations, Clebsch-Gordan coefficients тау be put in 
the standard form 71 < 72 € j and m > 0. 


& 0.707107 
& 0.866025 
& 0.707107 
& 0.866025 
& 1.000000 


& 0.707107 
& 0.408248 
& 0.707107 
& 0.750000 


yle мін мн 
Nie Nie 


& 0.559017 
s 0.816496 


о c 


& 0.866025 
s 0.8164967 
& 0.353553 


әре мәре nie 


& 0.790569 


©. „©. © © € © 


mn 


& 0.707107 


2 
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юе nie мге Nie nie 


0 
0 


юке wie nie 


= e e 


& 0.707107 
& 0.707107 
s —0.353553 
& 0.790569 
а 0.912871 
а 0.853913 
& —0.707107 
& 0.408248 
& 0.577350 
& —0.750000 
& 0.559017 
& 0.790569 
а —0.707107 
& 0.707107 
& 1.000000 
а 0.853913 
& 1.000000 


6.23 INTEGRAL TRANSFORMS: PRELIMINARIES 


1. I = (a,b) is an interval, where —oo <a < b < оо. 


2. L! (I) is the set of all absolutely integrable functions on J. In particular, L! (IR) 
is the set of all absolutely integrable functions on the real line R. 


3. L?(T) is the set of all square integrable functions on I (i.e., |, |f(a)|? da < оо). 


4. If f is integrable over every finite closed subinterval of J, but not necessarily 
on I itself, we say that f is locally integrable on I. For example, the func- 
tion f(x) = 1/2 is not integrable on the interval J = (0,1), yet it is locally 
integrable on it. 


5. A function f(a), defined on a closed interval [a, b], is said to be of bounded 
variation if there is an M > 0 such that, for any partition a = 20 < zı < 
n 


<< Zn = b, the following relation holds: 5 |f (xi) — f (ziz )| < M. 
i=1 
6. If f has a derivative /” at every point of [a, b], then by the mean value theorem, 


for any a < z < y < b, we have f(x) — f(y) = f'(z)(x — y), for some 
x <z < y. If f is bounded, then f is of bounded variation. 


7. The left limit of a function f(x) at a point ¢ (if it exists) will be denoted by 
lim, ,,- f(z) = f(t—), and likewise the right limit at ¢ will be denoted by 


lim, 31+ f(x) = f (t+). 


6.24 FOURIER TRANSFORM 


The origin of the Fourier integral transformation can be traced to Fourier’s celebrated 

work on the Analytical Theory of Heat, which appeared in 1822. Fourier’s major 

finding was to show that an “arbitrary” function defined on a finite interval could 

be expanded in a trigonometric series (series of sinusoidal functions, see Section 

1.4). In an attempt to extend his results to functions defined on the infinite interval 

(-оо, co), Fourier introduced what is now known as the Fourier integral transform. 
The Fourier integral transform of a function f(t) is defined by 


F(f)w) = fw) = FW) = |. (е? а, (6.24.1) 


whenever the integral exists. 
There is no universal agreement on the definition of the Fourier integral trans- 
form. Some authors take the kernel of the transformation as e ~*”, so that the kernel 
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of the inverse transformation is е. In either case, if we define the Fourier transform 
as 


fu) 2a | fe" dt, 
then its inverse is f(t) =b f(w)e™™ du, (6.24.2) 


for some constants a and b, with ab — 1/27. Again there is no agreement on the 
choice of the constants: sometimes one of them is taken as 1 so that the other is 
1/(27). For the sake of symmetry, we choose a = b = 1/ V2. The functions f and 
f are called a Fourier transform pair. 

Another definition that is popular in the engineering literature is the one in which 
the kernel of the transform is taken as e?7 (or e~?7*) so that the kernel of the 
inverse transform is e "274% (or 27929), The main advantage of this definition is that 
the constants a and b disappear and the Fourier transform pair becomes 


Ёш) = / fe?" dt аа ЈО) = / flu)eT?TIte dw. (6.24.3) 
The Fourier cosine and sine coefficients of f(t) are defined by 
laj 1. of | 
úl | fl ө КАЕ und TON = | f(t)sinwtdt. (6.24.4) 
T J осо T J—oo 


The Fourier cosine and sine coefficients are related to the Fourier cosine and 
sine integral transforms. For example, if f is even, then a(w) = ,/2/тЕ,(ш) and, if 
f is odd, b(w) = ,/2/тЕ,(ш) (see Section 6.24.7). 

Two other integrals related to the Fourier integral transform are Fourier's re- 
peated integral and the allied integral. Fourier's repeated integral, S( f, t), of f (t) is 
defined by 


S(f,t) = ЙІ (a(w) cos ә + blu) sin tw) du, 


O WE (6.24.5) 
2 2| “| f(x) cosw(t — x) dx. 
T Jo —00 
The allied Fourier integral, S(f,t), of f is defined by 
S(f,t) = | (b(w) costw — а(ш) sin tu) du, 
? (6.24.6) 


Ju аш Г. f(x) sin ш(ж — t)dx. 


6.24.1 EXISTENCE 


For the Fourier integral transform to exist, it is sufficient that f be absolutely inte- 
grable on (-оо, оо), i.e., f € Ľ“(R). 
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THEOREM 6.24.1 (Riemann—Lebesgue lemma) 
If f € LMR), then its Fourier transform Қо) is defined everywhere, uniformly 


continuous, and tends to zero as u — +оо. 


The uniform continuity follows from the relationship 


flw+h)— 17001 ед — 1| dt, 


ШЕН 


and the tendency toward zero as w — +оо is а consequence of ће Riemann- 
Lebesgue lemma. 


THEOREM 6.24.2 (Generalized Riemann—Lebesgue lemma) 


Let f € LÀ (I), where I = (a,b) is finite or infinite and let ш be a real variable. Let 
a € a! <b! < band f, Aa, b) =; feit dt. Then lim //,О,а,5)-0, 
U —+ 100 


and the convergence is uniform in a! andb'. In particular, lim [> Ре dt = 0. 
U — 100 


6.24.2 PROPERTIES 
1. Linearity: The Fourier transform is linear, 
F [af (t) + bg(t)] (w) = aF [FO] (v) + DF [900] (v) = af (w) + bý(w), 
where a and b are complex numbers. 
2. Translation: F |f (t — b)] (w) = ej“ (ш). 
3. Dilation (scaling): F [f(at)] (o) = Lf(2), а>0. 


4. Translation and dilation: 


F [flat - b] (2) = ze" f(S), ад, 


5. Complex conjugation: F [70] (w) = f(—w). 


6. Modulation: F [е^ f(1)] (ш) = f(w + a), and 


F | “НО (w) = 2) (* т *) ‚ b>0. (6257) 


7. Differentiation: If }®) € L! (R), for k = 0,1,2,:-- ,n and 
lim +300 f) (t) = 0 for k = 0,1,2,--: ,n — 1, then 


F | ғ” (0) (w) = (—iw)" fw). (6.24.8) 
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8. Integration: Let f € L' (R), and define g(x) = f^... f(t) dt. If g € L'(R), 
then 004) = —f(w)/ (iw). 
9. Multiplication by polynomials: If t* f(t) € L!(R) fork = 0,1,...,n, then 


F [EFO] (0) = Ff" (u), (6.24.9) 


and hence, 


F n u ro) «= У ЕГ (w). (6.24.10) 
k—0 


10. Convolution: The convolution operation, x, associated with the Fourier trans- 
form is defined as 


A) (raj = -= Ї Бр, 


where f and g are defined over the whole real line. 


THEOREM 6.24.3 


If f and g belong to L! (R), then so does h. Moreover, h(w) = f(w)g(w). If 
f and ў belong to LMR), then (f x 9)(w) = (fg)(w). 


11. Parsevaľ s relation: If f, g € L?(IR), andif F and G are the Fourier transforms 
of f and g respectively, then Parseval’s relation is 


| " PUG) das 1) ^ FOÀ dt. (6.24.11) 


Replacing G by С (so that g(—t) is replaced by g(t)) results in a more conve- 
nient form of Parsevaľ "s relation 


| ў F(w)G(w) dw = | И f(t)g(t) dt. (6.24.12) 
In particular, for f — g, 
à |F(w)|? аш = a ПОШ dt. (6.24.13) 
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6.24.3 INVERSION FORMULA 


Many of the theorems on the inversion of the Fourier transform are based on Dini’s 
condition which can be stated as follows: 
If f € L! (IR), then a necessary and sufficient condition for 


S(f,z) lim = Ji f(t) үшім ёс БОГТ. (6.24.14) 
is that 
: Ы зїп Ау 
lim | (f(@+y)+ f(x- y) — 2a) ——-dy = (6.24.15) 
à> Jo 
for any fixed 6 > 0. 
By the Riemann-Lebesgue lemma, this condition is satisfied if 
ó 
—9)-2 
| БЕБЕ ау < оо, (6.24.16) 
0 


for some 6 > 0. In particular, condition (6.24.16) holds for a = f(x), if f is 
differentiable at т, and for a = [f(a+) + f(a—)] /2, if f is of bounded variation in 
a neighborhood of z. 


THEOREM 6.24.4 (Inversion theorem) 


Let f be a locally integrable function, of bounded variation in a neighborhood of the 
point x. If f satisfies either one of the following conditions: 


1. f(t) € L' (I), ог 


2. f(t)/(1+|t|) € L'(R), and the integral JEA f (t)e* dt converges uniformly 
on every finite interval of w, 


then 


| fec do = dm = flw dw 


is equal to [f (z4-) + Қа-) /2 whenever the expression has meaning, to f (x) when- 
ever f(x) is continuous at x, and to f (x) almost everywhere. If f is continuous and 
of bounded variation in the interval (a,b), then the convergence is uniform in any 
interval interior to (a, b). 


6.24.4 POISSON SUMMATION FORMULA 


The Poisson summation formula may be written in the form 


1 = kr) о Sj —2ikto 
2 (e >) E y. f(2ko)e , о>0, (62417) 


k=—0o k——oo 
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provided that the two series converge. A sufficient condition for the validity of Egua- 
tion (6.24.17) is that f = O(1 + [t]) 7“ as |Ң > oo, and f = O((1 + |w)7“) as 
|w| — оо for some a > 1. 

Another version of the Poisson summation formula is 


» Ко + Ко)д(ш + Ко) = 2517 f(t) 2(- 5) ене, 


k2—00 2 55 
(6.24.18) 


6.24.5 SHANNON'S SAMPLING THEOREM 


If f is a function band-limited to [—o, с], i.e., 


w)e™ аш, 


f= | ғ 


with F € L?(—o,c), then it can be reconstructed from its sample values at ће points 
ty = (Ет) /о, Е = 0, +1, +2,---, via the formula 


> Ғы шашы (6.24.19) 
k—— 00 


with the series absolutely and uniformly convergent on compact sets. 
The series on the right-hand side of Eguation (6.24.19) can be written as 


—1)% 
sin ot 5 ғар Жы A which is а special case of a Cardinal series (these se- 
a (ot — kr) 


oo 
ries have the form sin ot C k —— 
d ue 5 (ot — Ет) 


6.24.6 UNCERTAINTY PRINCIPLE 
Let T and W be two real numbers defined by 


1 со 1 оо A 
т-р] вілора ma W2 | ole) do, (62420 


where am 
Е = Ган (t)|? dt = | |f(w)|? dw. (6.24.21) 
—oo 
Assuming that f is differentiable and Eb tf^ (t) = 0, then 2TW > 1, or 
1|-» оо 


со 1/2 со 1/2 со 
(f erora) (f өлөг) » 3]. ӨР dt. (6.24.22) 


This means that f and f cannot both be very small. Another related property of the 
Fourier transform is that, if either one of the functions f or f vanishes outside some 
finite interval, then the other one must trail on to infinity. In other words, they can 
not both vanish outside any finite interval. 
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6.24.7 FOURIER SINE AND COSINE TRANSFORMS 


The Fourier cosine transform, F.(w), and the Fourier sine transform, Е, (и), of f(t) 
are defined for w > 0 as 


a2 fn f(t)coswtdt and ЕД vay? fn f(t) sin wt dt. 


(6.24.23) 
The inverse transforms have the same functional form: 


0-2 [ra ) созш? dw = (2 [ы ) sin wt dw. (6.24.24) 


If f is even, i.e., f(t) = f(—t), then F(w) = F.(w), and if f is odd, i.e., 
f(t) = – (0), then F (w) = iF (w). 


6.25 DISCRETE FOURIER TRANSFORM (DFT) 


The discrete оа transform of ће sequence (ab), where N > 1, is a se- 


n= 5 * 
guence 44.1 о» defined by 
N-1 
Am = у an(Ww)™, г m=0,1,---,N-1, (6.25.1) 
n=0 


where Wy = e?"*/N. Note that Уһ 1 wok- ") — Nó. For example, the DFT 
of the sequence (1,0, 1, 1} is (3, —i, ned 
The inversion formula is 


N-1 
1 E 
ъ=? ‚Ату n2—0,1,:--,N —1. (6.25.2) 


Equations (6.25.1) and (6.25.2) are called a discrete Fourier transform (DFT) pair of 
order N. The factor 1/N and the negative sign in the exponent of W y that appear 
in Equation (6.25.2) are sometimes introduced in Equation (6.25.1) instead. We use 
the notation 


Ха) = Am Уу) = an, (6.25.3) 
to indicate that the discrete Fourier transform of order N of the sequence {a pn} is 
{Am} and that the inverse transform of {Am 18 {an}. 

Because wai Na NC Го (6.25.1) апа (6.25.2) can be used to 
extend the sequences (a 1^ Ts Т and {А} — nw " as periodic sequences with period 


N. This means that Алам = Am, and арфу = dn. This will be used in what 
follows without explicit note. Using this, the summation limits, 0 and N — 1, can 
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be replaced with n; and nı + N — 1, respectively, where n, is any integer. In the 
special case where n; = —M and N = 2M + 1, Equations (6.25.1) and (6.25.2) 
become 


An = УХ an WẸ”, for т--М,-М41,.,М-1,М, (6254) 


1 = 
n= згрт Dl AeWRU. for n=-M,-M +1, -ын. 


(6.25.5) 


6.25.1 PROPERTIES 
1. Linearity: The discrete Fourier transform is linear, that is 
Fnia(an) 2x B(bn)] = «Ам, + BBm, 


for any complex numbers a апа д, where the sum of two sequences is defined 
as (аһ) + (bn) = (an + bn). 


2. Translation: Fnl(an—k)] = WR* Am, or e?rimk/N A. = poe Gn RW. 
3. Modulation: FN[(W8*a,)| = Am44, 0r Am+k = x ӨР а WR, 


4. Complex Conjugation: Ғұ(а-,)|- Am, ог Am = ews а.а". 


5. Symmetry: Fnlla -n)| = A-m,or A-m = хо а-а Ар 


6. Convolution: The convolution of the sequences {а„} 2 and (0,1: is ће 
sequence (c, M d. given Бу 


N—1 
Cn = X ар. (6.25.6) 
k—0 


The convolution relation of the DFT is Ум си) = Fn[(an)|Fn[(bn)], or 
Cm = AmBm. A consequence of this and Equation (6.25.2), is the relation 


N-1 1“ 
M abuk- "s УАВ, (6.25.7) 
k—0 m=0 
7. Parseval’s relation: 
N-1 1 Уч! 
X andn = i ALB. (6.25.8) 
n=0 m=0 
In particular, 
N-1 1 №1 
У а = a Sal: (6.25.9) 
n=0 m=0 
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In (4) and (5), the fact that W y = Wy has been used. A sequence {anp } is said 
to be even if {a_,} = {an } and is said to be odd if {a-n} = {—an }. The following 
are consequences of (4) and (5): 


1. If {an} is a sequence of real numbers (i.e., 25 = an), then А, = A m. 
2. fan is real and even if and only if {Am } is real and even. 


3. {an} is real and odd if and only if {Am } is pure imaginary and odd. 


6.26 FAST FOURIER TRANSFORM (FFT) 


To determine Am for each m = 0,1,--- ‚М — 1 (using Equation (6.25.1), M — 1 
multiplications are required. Hence the total number of multiplications required to 
determine all the A,,’s is (M — 1)?. This number сап be reduced by using decima- 
tion. 

Assuming M is even, we define M = 2N and write 


F2n[(Gn)] = Am: (6.26.1) 


Now split {an} into two sequences, one consisting of terms with even subscripts 
(б, = аән) and one with odd subscripts (с, = d2n+1). Then 


Am = Bm Ms (6.26.2) 


For the evaluation of Bm апа Cm, the total number of multiplications required is 
2(N — ТІ, To determine Am from Equation (6.26.2), we must calculate the product 
ИЛ Cm, for each fixed m. Therefore, the total number of multiplications required 
to determine Am from Equation (6.26.2) is 2(N — 1)? +2N —1—2N? —2N + 1. 

But if we had determined Am from (6.26.1), we would have performed (2N — 
1)? = 4N? — AN +1 multiplications. Thus, splitting the sequence {a,,} into two 
sequences and then applying the discrete Fourier transform reduces the number of 
multiplications required to evaluate А, approximately by a factor of 2. 

If N is even, this process can be repeated. Split {bn} and {cp} into two se- 
quences, each of length N/2. Then Bm and Cm are determined in terms of four 
discrete Fourier transforms, each of order N/2. This process сап be repeated k — 1 
times if M — 2* for some positive integer k. 

If we denote the required number of multiplications for the discrete Fourier 
transform of order N = 2% by F(N), then F(2N) = 2F(N) + N and F(2) = 1, 
which leads to F(N) = 2 log, N. 
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6.27 MULTIDIMENSIONAL FOURIER TRANSFORM 


If x = (z1,22,..., 24) and u = (u1,U2,... ,Un), then (see table on page 604): 
1. Fourier transform F(u) — (27) 79/2 Ї + f  (х)е ч) dx. 
2. Inverse Fourier transform fix) = 21) 712 f мо du. 
3. Parsevaľ s relation fof Eg) dx ES + f F(u)G(u) du. 
в" в" 


6.28 LAPLACE TRANSFORM 


The Laplace transformation dates back to the work of the French mathematician, 
Pierre Simon Marquis de Laplace (1749—1827), who used it in his work on probabil- 
ity theory in the 1780’s. 

The Laplace transform of a function f(t) is defined as 


B E ! T He dt (6.28.1) 


(also written as [Z f (t)] and [£ (f(t))] ), whenever the integral exists for at least one 
value of s. The transform variable, s, can be taken as a complex number. We say 
that f is Laplace transformable or the Laplace transformation is applicable to f if 
[£ f] exists for at least one value of s. The integral on the right-hand side of Equation 
(6.28.1) is called the Laplace integral of f. 


6.28.1 EXISTENCE AND DOMAIN OF CONVERGENCE 
Sufficient conditions for the existence of the Laplace transform are 


1. f is a locally integrable function on [0, oo), i.e., px |f(t)|dt < oo, for any 
a > 0. 


2. f is of (real) exponential type, i.e., for some constants M,tg > 0 and real y, f 
satisfies 
|/(®| < Me™, for all t > to. (6.28.2) 


If f is a locally integrable function on [0, оо) and of (real) exponential type 7, 
then the Laplace integral of f, 17 f(t)e—* dt, converges absolutely for Re s > y 
and uniformly for Re s > 71, for any yı > y. Consequently, F(s) is analytic in 
the half-plane О = (s € C: Res > y]. It can be shown that if F(s) exists for 
some sg, then it also exists for any s for which Re s > Re sg. The actual domain 
of existence of the Laplace transform may be larger than the one given above. For 
example, the function f(t) = cos e* is of real exponential type zero, but F(s) exists 
for Re s > —1. 
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If f(t) is a locally integrable function on [0, оо), not of exponential type, and 


| B Бегеш (6.28.3) 
0 


converges for some complex number s g, then the Laplace integral 


| í FO dt (6.28.4) 
0 


converges in the region Re s > Re sg and also converges uniformly in the region 


[arg(s — so)| € 9 < 5. Moreover, if Equation (6.28.3) diverges, then so does 


Equation (6.28.4) for Re s < Re so. 


6.28.2 PROPERTIES 


1. Linearity: L(af + 8g) = al(f) + BL(g) = aF + BG, 
for any constants a and ©. 


2. Dilation: |£ (f(at))] (s) = їр (5); for a > 0. 


3. Multiplication by exponential functions: 


[£ (е f(0)] (s) = F(s — a). 


4. Translation: |L (f (t — a) H(t — a))| (s) = e **F(s) for a > 0. This can be 
put in the form 


[CCf (t) H(t — a))] (s) = e ** [Cf (t a))] (s), 


where H is the Heaviside function. Examples: 


(a) If 
(xs 0, 0<t<a, 
лу: 
then g(t) = f(t — a) H(t — a) where f(t) = t"(Rev > —1). Since 
L(t”) = Tv + 1)/s"*1, it follows that (Lg) (s) = e79T(v +1)/5"+!, 
for Re s > 0. 
(b) If 


(i) = t, 0<t<a, 
дн 0, a<t, 


we may write g(t) = t[H (t) — H(t — a)| = tH(t) — (t —a) H(t—a) 
aH (t — a). Thus by properties (1) and (4), 


=. 1 а 
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5. Differentiation of the transformed function: If f is a differentiable function of 
exponential type, lim;04 f(t) = f(0+) exists, and f’ is locally integrable 
оп (0, оо), then the Laplace transform of f’ exists, and 


(Lf') (s) = sF(s) — f(0). (6.28.5) 


Note that although f is assumed to be of exponential type, f’ need not be. For 
example, f(t) = sin et”, but f'(t) = 2te’ cos et” 


6. Differentiation of higher orders: Let f be an n times differentiable function 
so that f (for k = 0,1,...,n — 1) are of exponential type with the addi- 
tional assumption that lim, зор f?) (t) = f™ (0+) exists. If f is locally 
integrable on [0, oo), then its Laplace transform exists, and 


[e (709) | (5) = sF (8) — "7 FO) — s= 70) —...— £079). 
(6.28.6) 
7. Integration: If g(t ЗЭ x) ат, then (if the transforms exist) G(s) = 

F(s)/s. Repeated А Т this гше result іп 
1 

n) = —F 287 
eU) ©) = ZF, (6.28.1) 
where f(7") is the n'^ anti-derivative of f defined by f (^?) (t) = dc dtn fo” 


а-а.” ey (t4) dt4. Section 6.28.1 shows that the Laplace transform is an 
analytic function in a half-plane. Hence it has derivatives of all orders at any 
point in that half-plane. The next property shows that we can evaluate these 
derivatives by direct calculation. 


8. Multiplication by powers of t: Let f be a locally integrable function whose 
Laplace integral converges absolutely and uniformly for Re s > c. Then F is 
analytic in Re s > c, and (for n = 0,1,2,..., with Re s > о) 


iens = (2) Fe, 


«(47 т) (4 ru 


)" is the operator (1-2) applied n times. 


(6.28.8) 


4. 


where (1 2 


9. Division by powers of t: If f is a locally integrable function of exponential 
type such that f(£) /t is a Laplace transformable function, then 


Ё (£y me | P pue (6.28.9) 


ог, more generally, 


| (I С = f- ЇЇ» (81) 481 ds» +++ ds, (6.28.10) 


83 82 
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is the n^ repeated integral. It follows from properties (7) and (9) that 
t ] 1 со 
[Pe | (в) = JE du. (6.28.11) 
0 


10. Periodic functions: Let f be a locally integrable function that is periodic with 
period T'. Then 


Т 
[L(f)] (s) = т 177 EC e^? dt. (6.28.12) 
0 
11. Hardy's theorem: If f(t) = У? усь" fort > бала Y 
for some so > 0, then [C(f)] (s) = Epo 5222 ! for Re s > so. 


6.28.3 INVERSION FORMULAE 


6.28.3.1 Inversion by integration 
If f(t) is a locally integrable function on [0, оо) such that 


1. f is of bounded variation in a neighborhood of a point tọ > 0 (a right-hand 
neighborhood if tg = 0), 


2. The Laplace integral of f converges absolutely on the line Re s = c, then 


Еч 0, if to < 0, 
2o f Fís)ešto ds = f(0+)/2 if to = 0, 
оу [/(to--) + f(to—)]/2 if > 0. 


In particular, if f is differentiable on (0, oo) and satisfies the above conditions, 
then 


1 cti 
lim -— f Е(в)е**ав = f(t), 0<t< оо. (6.28.13) 
T—oo 271 
c—iT 


The integral here is taken to be a Cauchy principal value since, in general, this inte- 

gral may be divergent. For example, if f(t) = 1, then F(s) = 1/s and, for c = 1 
1--100 

and £ = 0, the integral J i ds diverges. 


1—ioo 
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6.28.3.2 Inversion by partial fractions 


Suppose that F is a rational function F(s) = P(s)/Q(s) in which the degree of 
the denominator Q is greater than that of the numerator P. For instance, let F be 
represented in its most reduced form where P and Q have no common zeros, and 


assume that Q has only simple zeros at a1, .. . , an, then 
Ё Е 2) S Рақ) ац 
EE RS eu = АЁ, 6.28.14 
f - £^ o) = e (28) o Z gia)“. 62814) 


EXAMPLE If P(s) = s—5and Q(s) = s“ +65+13, then a; = —3+2i, a» = —3— 2i, 
and it follows that 
» =5 (Qi c Bj go ДӘНЕШ 1-3: 
dug Кселл Ды (-342i) , (21 +8) ( i) 
Ne (51m) 4i “ dede 
= e77 (cos 2t — Asin 2t). 


6.28.4 CONVOLUTION 


Let f(t) and g(t) be locally integrable functions on [0, oo), and assume that their 
Laplace integrals converge absolutely in some half-plane Re s > a. Then the con- 
volution operation, ж, associated with the Laplace transform, is defined by 


h(t) = (f *g)(t) = | (ow — x) dz. (6.28.15) 
0 


The convolution of f and g is a locally integrable function on [0, oo) that is contin- 
uous if either f or g is continuous. Additionally, it has a Laplace transform given 
by 

H(s) = (Ch) (s) = F(s)G(s), (6.28.16) 


6.29 HANKEL TRANSFORM 


The Hankel transform of order v of a real-valued function f (x) is defined as 


М.(00) = E(y) = | dyes dod (629.1) 


for y > Oandv > —1/2, where /,(2) is the Bessel function of the first kind of 
order v. 

The Hankel transforms of order 1/2 and —1/2 are equal to the Fourier sine and 
cosine transforms, respectively, because 


|2 |2 
Луз(@) = T sin 2, 7_1/2(&) = eet (6.29.2) 
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As with the Fourier transform, there are many variations on the definition of the 
Hankel transform. Some authors define it as 


G,(y) = JA 7 zg(x)J, (yx)da; (6.29.3) 


however, the two definitions are equivalent; we only need to replace f(x) by J/zg(z) 
and F, (y) by /yG, (y). 


6.29.1 PROPERTIES 


1. Existence: Since J/zJ, (x) is bounded on the positive real axis, the Hankel 
transform of f exists if f Є L“(0, оо). 


2. Multiplication by 2": 
ld 


Hy (a а) (y) = yt?” G 


y 5) |y * "71 Fus (y) Ň 


3. Division by 2: 


Hy E0 (y) = y [Fv-1(y) + Frsily)], 


Hy (4%) (y) = у!/?—” i ГЭЭШ F, (t) dt. 


0 


апа а]зо 


4. Differentiation: 
Hy (2v (а) (y) = (v — 1/2)yFr4a(y) — Gr 1/2)yF, i (y). 


5. Differentiation and multiplication by powers of x: 


н, er (FE) (m9) 0) =v Fem) 


rdc 


6. Parseval's relation: Let Е, апа G, denote the Hankel transforms of order v 
of f and g, respectively. Then 


] rec = | гэвэл, (6294) 
0 0 
In particular, 


| IF, (v) dy = | |f) dz. (6.29.5) 
0 0 


7. Inversion formula: If f is absolutely integrable on (0,00) and of bounded 
variation in a neighborhood of point x, then 


І i Fly) /zyJ(yx) dy = E (6.29.6) 


whenever the expression on the right-hand side of the equation has a meaning; 
the integral converges to f(x) whenever f is continuous at z. 
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6.30 HARTLEY TRANSFORM 


Define the function cas x = cos x +sin т. The Hartley transform of the real function 
g(t) is 


CHOE f E (6.30.1) 
Let (Eg)(w) and (Og)(w) be the even and odd parts of (Hg) (w), 
(кк) = 5 (H9) w) + (H9)(—w)) 
^ (6.30.2) 
(00) = 5 ((Hg)(w) — (Hg)(-w)) , 


so that (Hg) (ш) = (Eg)(w)+(Og)(w). The Fourier transform of g (using the kernel 
e?7i^t) can then be written in terms of (Eg)(w) апа (Og)(w) as 


Ї B g(t)e?*'*t dt = (Eg)(w) + i(Og)(w). (6.30.3) 


— 00 
Note that the Hartley transform, applied twice in succession, returns the original 
function. 


6.31 HILBERT TRANSFORM 


The Hilbert transform of f is defined as 


(НР) (z) -if ын = а=1 |. е (6.31.1) 


where the integral is a Cauchy principal value. A table is on page 612. 

Since the definition is given in terms of a singular integral, it is sometimes im- 
practical to use. An alternative definition is given below. First, let f be an integrable 
function, and define a(t) and b(t) by 


p RS 1 р 
тыге | f(a) cos tzdz, b(t) = — | fa) sin tr dx. (6.31.2) 
Лл) со TI 
Consider the function F (z), defined by the integral 


z) - | (ale) — ib(t))e'** dt = U(z) + iŬ (2), (6.31.3) 
0 


where z = x + iy. The real and imaginary parts of F are 


(К cos at + b(t) sin те”? dt, and 
0 (6.31.4) 
(a(t) 


U(z) 
Ú (z) 1 a(t) sin zt — b(t) cos 21)е У dt. 
0 
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Formally, 


lim U(z) = f(x) = | «o cos zt + b(t) sin xt) dt, (6.31.5) 
y0 0 
and ms 
lim U(z) = —f(«) = И (a(t) sin xt — b(t) cos xt) dt. (6.31.6) 
y0 0 


The Hilbert transform of a function f, given by Equation (6.31.5), is defined as 
the function f given by Equation (6.31.6). 


6.31.1 EXISTENCE 


If f € L“(R), then its Hilbert transform (H f)(x) exists for almost all r. For f € 
L? (R), p > 1, there is the following stronger result: 


THEOREM 6.31.1 


Let f € L?(R) for 1 < p < oo. Then (Hf)(x) exists for almost all x and defines a 
function that also belongs to L? (IR) with 


[eie ae о, [^ OP ас (6317) 
In the special case of р = 2, we have 
| ноа f Fa as (631.8) 


The theorem is not valid if p = 1 because, although it is true that (H f)(x) 
is defined almost everywhere, it is not necessarily in Ľ!(R). The function f(t) = 
(tlog? t)! H(t) provides a counterexample. 


6.31.2 PROPERTIES 


1. Translation: The Hilbert transform commutes with the translation operator 


(Hf)(@ +a) = H(f(t + a) (z). 


2. Dilation: The Hilbert transformation also commutes with the dilation operator 


(МЈ) (ах) = H(f(at)) (x) a> 0, 


but 
(Н?) (ах) = —H(f(at))(«) fora < 0. 
3. Multiplication by t: H(tf(t)) (x) = (Hf) (x) + 1 Е f(t) dt. 
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4. Differentiation: L(f'(t))(z) = (H f)' (x), provided that f(t) = O(t) as |t| > 
oo. 


5. Orthogonality: The Hilbert transform of f € L?(IR) is orthogonal to f in the 
sense f^^. f(z)(Hf)(x)dx = 0. 


6. Parity: The Hilbert transform of an even function is odd and that of an odd 
function is even. 


7. Inversion formula: If (Hf)(x) = 3 10 dt, then 
25-2 


ЖЕ = 22 n HD) 4, or, symbolically, 
mob DZA 


H (Hf) (z) = — f(x), (6.31.9) 


that is, applying the Hilbert transform twice returns the negative of the original 
function. Moreover, if f € L!(IR) has a bounded derivative, then the allied 
integral (see Equation 6.24.6) equals (H f)(x). 


8. Meromorphic invariance: 


CEC е Oe | = 221 fle) 


7 J st— uz) TJ œ t-r 


u() =t- 5 


n=1 


for arbitrary a, > 0 and b,, real. 


6.31.3 RELATIONSHIP WITH THE FOURIER TRANSFORM 
From Equations (6.31.3)-(6.31.6), we obtain 


lim F(z) = F(a) = [ «o = ib(t))e™* dt = f(x) — (НР) (х), 


y—0 


where a(t) and b(t) are given by Equation (6.31.2). 
Let g be a real-valued integrable function and consider its Fourier transform 
(2) = Үл 25900) е!" dt. If we denote the real and imaginary parts of ў by f 


and ri , respectively, then 


f(x) = = 2 g(t) cos xt dt, and 


1 ү | 
f(z) = рут Г g(t) sin xt dt. 
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Splitting g into its even and odd parts, ge and go, respectively, we obtain 


t -? t) — g(—t 
g(t) = EI а g(t) = 2 E 1 
hence 
2- 9% 2 2; 479 : 
-ү? / ge(t) cos xt dt, апа £o - ү2 f go(t) sin xt dt, 
7T Jo 7T Jo 
(6.31.10) 
or 
eitt Ё з= Ё iat 
f(x) = Sal. dt, and №) = = 2940 dt. 
(6.31.11) 


This shows that, if the Fourier transform of the even part of a real-valued function 
represents a function f(x), then the Fourier transform of the odd part represents the 
Hilbert transform of f (up to multiplication by 4). 


THEOREM 6.31.2 
Let f € L! (R) and assume that Hf is also in L! (IR). Then 
F(Hf)(w) = —isgn(w)F(f)(w), (6.31.12) 


where F denotes the Fourier transformation. Similarly, if f € L?(R), then (Hf) € 
L? (R), and Equation (6.31.12) remains valid. 


6.32 Z-TRANSFORM 


The Z-transform of a sequence { f (n) 2 is defined by 


Z1f(n) => fin (6.32.1) 


п=—со 


for all complex numbers z for which the series converges. 
The series converges at least in a ring of the form 0 € rı < |z| < r2 < оо, 
whose radii, r] and r2, depend on the behavior of f (n) at +оо: 


1 
rı = limsup V |f (n)|, Ta = lim inf ————.. (6.32.2) 
ime A VICO) 


If there is more than one sequence involved, we may denote rı and тэ by ri(f) 
and r»(f) respectively. It may happen that rı > r2, so that the function is nowhere 
defined. The function F(z) is analytic in this ring, but it may be possible to continue 
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it analytically beyond the boundaries of the ring. If f(n) = Oforn < 0, then 
Ta = oo, and if f(n) = О for n > 0, then rı = 0. 

Let z = геі. Then the Z-transform evaluated at r = 1 is the Fourier transform 
of the sequence { f (т) } ы» 


M f(n)e **. (6.32.3) 
6.32.1 EXAMPLES 


1. Let a be a complex number and define f(n) = a", for n > 0, and zero 
otherwise, then 


oo 
2 
Z. = = : 6.32.4 
[/(п)] х: "=-—— , dll (6.32.4) 
1 >0 
Special case: unit step function. If a = 1 then f(n) = u(n) = | Ё р: d 
, n , 


2 


2. If f(n) = na^, for n > 0, and zero otherwise, then 


|а Уу пато" EVE |z| > la]. 
п=0 


(z — а)? 


1, п=0, 


. then Z[ó(n — k)] = z 7% fork = 0, +1, £2,.... 
0, otherwise, 


6.32.2 PROPERTIES 


Let the region of convergence of the Z-transform of the sequence { f (n)) be denoted 
by D f: 


1. Linearity: 
Z|af (n) +bg(n)] = aZ[f(n)]+b2Z[g(n)] = aF(z)+bG(z), 2єр;пр,. 


The region D у (^] D, contains the ring r1 < |z| < ғә, where 
ry = maximum fri(f),r1(g)+ and rə = minimum {r2(f), r2(g)}. 


2. Translation: Z[f (n — k)] = z-* F(z). 


3. Multiplication by exponentials: Z (a^ f(n))] = F(z/a) when |a|ri < |z| < |а. 
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4. Multiplication by powers of n: For k = 0,1,2,... and z € Юу, 


k 
Z[(n* f(n))] = (—1)* (-2) F(z). (6.32.5) 


= — [1 
5. Complex conjugation: 2|}(—т)| = F B А 
2 


6. Initial and final values: If f(n) = 0 for n < 0, then lim; зо F(z) = f(0) 
and, conversely, if F(z) is defined for ri < |z| and for some integer m, 
lim; 350 2 F(z) = A (with A # +оо), then f(m) = A and f(n) = 0, 
forn < m. 


7. Parsevaľ s relation: Let F,G € LÁ(—r,7), and let F(z) and G(z) be the 
Z -transforms of { f (n)) and {g(n)}, respectively. Then 


У 10980) = z- | F(e)G(e) du. (6.32.6) 
X P= x. |F(e™)|? dw. (6.32.7) 


6.32.3 INVERSION FORMULA 


Consider the sequences 


І, n>0, 
0, n<0, 


-1, n<0, 
0, n > 0. 


and g(n) = —u(-n —1) = | 


2 2 


Note that F(z) = ї for |z| > 1, and G(z) = 1 
2- 2- 


inverse Z-transform of the function 2/(2- 1) is not unique. In general, the inverse 
Z-transform is not unique, unless its region of convergence is specified. 


for |z| < 1. Hence, the 


1. Inversion by using series representation: 


If F(z) is given by its series 
со 
F(z) = 5 anz”, 2% |z| < Ta, 
n-—-—oo 


then its inverse Z-transform is unique and is given by f(n) = an for all n. 
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2. Inversion by using complex integration: 


If F(z) is given in a closed form as an algebraic expression and its domain of 
analyticity is known, then its inverse Z-transform can be obtained by using the 
relationship 

1 


xi 


where y is a closed contour surrounding the origin once in the positive (counter- 
clockwise) direction in the domain of analyticity of F(z). 


Ға) 4 F(z)2""'dz, (6.32.8) 
zy 


3. Inversion by using Fourier series: 


If the domain of analyticity of F contains the unit circle, |r| = 1, and if F is 
single valued therein, then F(e?“) is a periodic function with period 27, and, 
consequently, it can be expanded in a Fourier series. The coefficients of the 
series form the inverse Z-transform of F and they are given explicitly by 


f(n) : | г Е(е уед" 40. (6.32.9) 


= Эт S 
(This is a special case of (2) with (8) = е.) 


4. Inversion by using partial fractions: 


Dividing Equation (6.32.4) by z and differentiating both sides with respect to 
z results in 


—1 
2“ [(2 —a) +] = (" Ё 5 a^-*u(n — k), (6.32.10) 
for k = 1,2,... and |z| > |a| > 0. Moreover, 


27! [27%] = ô(n — k). (6.32.11) 
Let F(z) be a rational function of the form 


P(z) anz +... 4012 +49 


F — E LU 
(2) Q(z) bmz™ +...+ bız + bo 


with ах zz 0 and by #0. 


(a) Consider the case N « M. The denominator Q(z) can be factored over 
the field of complex numbers as Q(z) = e(z — 21) ++: (z — 2m)*™, 
where c is a constant and k1,...,km are positive integers satisfying kı + 
...c kg = M. Hence, F can be written in the form 


ui A; ; 
F(z) 23 =, (6.32.12) 
i21 j—1 а-а) 
where 
1 ы-і 
Aij =з lim LE — zi)" F(z). (6.32.13) 


(ki — j)! 22 dz*i-i 
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The inverse Z-transform of the decomposition in Eguation (6.32.12) in 
the region that is exterior to the smallest circle containing all the zeros of 
Q(z) can be obtained by using Equation (6.32.10). 


(b) Consider the case N > M. We must divide until F can be reduced to 
the form RG) 
z 
F(z) = H(z) + =, 
(2) =H) + S65 


where the remainder polynomial, R(z), has degree less than or equal to 
M — 1, and the quotient, H(z), is a polynomial of degree, at most, N — 
M. The inverse Z-transform of the quotient polynomial can be obtained 
by using Equation (6.32.11) and that of R(z)/Q(z) can be obtained as 
in the case N « M. 


EXAMPLE То find the inverse Z-transform of the function, 


4 
z +5 
F(z) = 212622) |z| > 2, (6.32.14) 
the partial fraction expansion, 
4 
z +5 6 10 21 
ааа +-—— 32.1 
(к= {кей 1717-12 1-0 6-2 (59245) 


is computed. With the aid of Eguation (6.32.10) and Eguation (6.32.11), 


Z^! [F(z)] = 6(n +1) + 46(n) — 6(n — 1)u(n — 2) 
— 10u(n — 1) +21-2"7!u(n —1), (6.32.16) 


or Қа) = —6n — 4 + 21 -2"7!, for n > 2, with the initial values f(—1) = 1, 
1(0) = 4, and f(1) = 11. 


6.32.4 CONVOLUTION AND PRODUCT 


The convolution of the two sequences, (f(n)) 2 and (g(n)) 7... is the sequence 


(h(n)YŤ.. defined by h(n) = Y. ,, f(k)g(n — k). The Z-transform of the 


ko 
convolution of two sequences is the product of their Z-transforms, 


Z[h(n)] = Z(f(n)]Zlg(n)]; (6.32.17) 


for z € Dg N Dg, or H(z) = F(z)G(z). 
The Z-transform of the product of two sequences is given by 


2 


#|/(а)а(®)] = 5— f F(w)G (=) - (6.32.18) 


W 


where ^ is a closed contour surrounding the origin in the positive direction in the 
domain of convergence of F (w) and G(z/w). 
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6.33 TABLES OF TRANSFORMS 


Finite sine transforms 


f(n) a F(x) sinng dx, forn = 1,2,.... 
0 


aa 0157. —— 
fomo TT ЕНІН 
Еи 


| 4-чу 000 | 


пт when 0 < r с 
— sim 97 
T-T гэг 


n— 


sinh c(T — x) 
sinh ст 


with k 40,1 sin (т — x) 
| ^ sinkm — 


n 
т/2 whenn =m 
A nú 


— k? 


=pli- (—1)" cos kr] 
магыз. (0if n = k) 


cos kx 


with k 40,1 msinka | zcosk(m — x) 
БА 2k sin? Ет sin? kr | 2ksinkn 
16 with |b| < 1 2 tan- bsin x 
Е 1 —bcosr 
1 Зүй = L^ 
17 l-CU*, with ІМ <1 СЕ 2b sin x 
i T 1-52 
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Finite cosine transforms 


fe(n) = 1 F(x) cosna ат, forn = 0,1,2,.... 
0 


1 for0<a<a/2 
—1 forrm/2< 1. «m 


coshe(r — x) 


csinh cr 


sin kx 


(r — x) 


cos k(r — x 


k sin kr 
with k £ 0,1,2,... 
7/2 whenn =m 


0 when n Z m 
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Fourier sine transforms 


F(w) = E(f)(w) = ш f(x) sin(wa) dr, w > 0. 


ыг s we). е; 


1—0 1+0 


Fourier cosine transforms 


maskas Та І он В, КЫЙ 


SB, ae g жааны) 


1—w 1+ 
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Fourier transforms: functional relations 


F(w) = F(f)(w) = 


т”е%% da: 


ТИ 


{жө rn — 
EE e 


Fourier transforms 


F(w) = F(f)(w) = 


xe dx 


1 oo 
л/ л 


lantur 
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Fourier transforms 


F(w) = F(f\w) = 3 1 ^ fei do 


© ET PU M 


Leo [yrs 
w|«a 
Lc ЦЕ 
W a 
Ds p«mc«q Е aee giae ta) /u+a 
a1 <Pp,Ľ >—g 
ercttiaz 
12 x>0 
0 <0 


m 


TE із sin £r 
lw] 


ell JA a a 


cosh aa uk 2 cos $ cosh € 
cosh та ( т<а< т) Visus тосоо 
sinhax = sina 


VZ Jn(aw) 


|» 


0 
КЕТ” =w?) |wl «b 


Zhu (w) 
М. (амы? + b?) 


JF Jo(avu? — b?) 
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Multidimensional Fourier transforms 
F(u = (27) ша. ЈР) jet dx 


761 Fw) 


In n-dimensions 


Two dimensions: let X — w and u = (u,v). 


Гэ» р n 
Hd ee 
EMI — 


a 


[емы b> 0 | у? /4b a,b > [емы b> 0 | FO —bv? 


|z| < a, |y| < b ЖООК 2 віп au sin а 
0 otherwise 
1 [z <a сн 2sinau , 
0 otherwise 4 


ал (avu? +v?) 


ми? + v? 


(circle) 


Three dimensions: let x = (x,y, z) and u = (u,v, w). 


1 —i(au+bu+cw 
EE a)ô(y — b)ó(z — c) [CS (au+bu+cw) 
e-* /4a— у? /Ab—z? /4с a,b,c >0 AA —bv? —cu7 


7 |z| <a, |y| < b, |z| « c * sin au sin bu sin cw 2-2 sin cw 
0 otherwise (box) 


а? +y? +2? <a o: 


1 (ball) SEV 7 
0 otherwise p? eu ei ap 
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Laplace transforms: functional relations 


= ri fe“ dt. 
би оооло “== 
ЕНЕГЕ 


P") F(s) — sF(0+) — F (04) 

F(t) F() - У i-re o) 

fo f) 

E р E 

ө pne — —— 

эө — ewe БЕНЕН 
12 | f(t — b) with f(t) =0 fort < 0 

| 


- Бог eet 
with g(t) = (t — a1): 


з | k) , 
k — 1)! 
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Laplace transforms 


F(s) = £(f)(s) = | ~ fOe dt. 


зо тг 


2 у, unit step function or | 1 /8 
з, function 
г р  .-т 


——— 
(n—1)! 

Sf — — E 
О Ааа 

Унт aware 


(s—a)(s—b) 
b—c)e?* 4-(c—a)e*t -(a—b)e*t 
ee emm (a, b, c distinct) 


E 0 
li TIE — 
нэ (sin at — at cos at) 
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Laplace transforms 


F(s) = £(f)(s) = | "наст", 
шаг го 


Ł 


1 pat qi 1 
ге” sin bt 1--17:12 


e% cos bt 
022 2n—k—1 
7 4п- лэг ЭЭГ ir ) 


x (—21)^-1 4. [cos bt] 


n—k— 2-і 
qp vez 0321 ) лд 
xf [a cos bt + b sin at] 
zabi A edere 


п—1 (Е—1)! 


s—a 
(8-а)2--52 


x4 a [sin bt] 


e at 


—eat/? (cos aty3 — V/3sin aA) 


242) až 8 
36 | (1+ at“) sin at — cos at Тос 


x 1 
ram 
BES ШҮ, 


ыны. 
40 ул — ae? <= UG 
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Laplace transforms 


кё) = eno) = [^ көте 


TRI гт 


EE 

ошый [шш — 
НЕ ts 

Ко сс — 


Өвгөн ач) b? 
et - (s — STE + Vs) 


D ee 


I т и = 

ебі erfe(bV2) Vs(s—a?) (V s+b) 

ыз ОО [к NN 
) 


EJ Rr es 


=at [T; (at) + Io(at)] 


(2n)! 


e- (a*0t/2 


e (a+b) 0 а- а-ы) 
1 
53 


іру: (® 1) 
te- (0091/2 [Jo (2522) 


+h (121) 
—at Мв+2а—\/8 Vs 
m 


(Vs? Fa? —s)". 272% 
(80) mcum 


je 1/2 
"m (55) Jg- 1/2(at) GU y 


a* (s—V/s2—a2)* 


Ł) k—1/2 


I, —1/2(at) Grm 
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Laplace transforms 


F(s) = 0000) = [ feta. 
0 
с —— c 
62 0 whenO<t<k 
1 whent>k 
63 when0ct«k 
t—k whent>k 
when0ct«k 
64 m 707 (р > 0) 


when t > k 
1 зэ Daet 
65 
0 whent 11. —) k 
sina} лс at| pr ONE [лов 200 | 
ж |; 
ег/8 

[шею Т» 
EE — sinh 2Vat 1110/5 


= 1)/ P 1 (2Vat) 4 070/5 
T He des 1 (2 vat) 


ze /% 


ү 


s 


На > 


a e 
E: m Нэр 0) 


еа [log a — Ei(—at)] 


сех ~ жт 
© © 
| Y 
o 


| Y 
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Laplace transforms 


кё) = epo) = [^ бета. 


83 ша t) Inm 


toga 
ET 13 


d 1(ebt EN pet) 


a) 5 
2loga — 2 Ci(at) + log(s? + a?) 
EJ — ыы at)] cdi s? 2 
2 
E b 


тоос 
а [онш еш 


when0<t<a 
- S Ko(as) 
n /2 whent >a 
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Hankel transforms 


0«4241 
1<хт 
Re v > —1 


Re nu > —1 
АРЫСЫ + a3)-v-1/2. 
Кеа>0, Rev > -1/2 
H1/26—az 

Re a > 0, 
H1/2 „—a27 


Re v > —1 


Rea >0, Rev > —1 


, Rev > —1 


—1—1/2 cos(az), 


а> 0, Rev > —1/2 
x)/27! віп(ал), 
a > 0, 


Jui (ax), 


a >0, 


Re v > 1/2 


Re v > —1 


Л-1(аз), 


a >0, Rev > —3/2 
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5 | "FG fag Gada. id 


2"T(u+1)a Peet yb 1/2 


x Jui (ay) 


ryť 1/2975 704 

x [Г(и + 1/2)! 
a(z)-1/22v*1, vH 2T (y + 3/2) 
х (až + y2)-v-3/2 


yo ийэ y? /4а) 


exp (— 


ph [erm 

x (až + y?)-1/2 

ry PIG +12] 
x (у? — a)” Aly — a) 
2. Ж 


(y? — až 1s 3/2 H (y 


qe 1 y "2H 


ERES 0<у<а 
0, 


а<у 


Hilbert transforms 


ala P Ше И 


0<у Fa, 


софа, 430) ax) 


БЕ — сов(ат) sin sin(ay) 


1/2) 


1 
sgn(z) sin(a|x|"/?) a >0 | cos( UE ) + exp(—aly| 
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Mellin transforms 


f'() = мб j= [fe үші dz. 


сг 


7ч 
Deme E 


O<Res<1 


O<Res<1 


mE cosec(rs) 
|arga| < т 
—1<Res < 0 
! sec(4rs) 
—1<Res < 0 


1 вес = 0<Кев<1 


ЕЕ Rea >0 | 4(2a)~*T(s)¢(s – 1) Res»2 


ШЕШІ Rea >0 | 4(2a)~*T(s)¢(s —1) Res»2 


a 5257 2 ER 
18 | К, (ax) iD iU 
x T((s +v)/2) Res > [Re v| 


TAssuming that lim; 304. 25777! fO) (y) = 0 forr = 0,1,...,п — 1. 


{Where J,, denotes the п repeated 1 of f(x): Inf(x) = f(x), Inf(a) = 


Jo Tn-1(t) dt 
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7.1 PROBABILITY THEORY 


7.1.1 INTRODUCTION 


A sample space S associated with an experiment is a set S of elements such that any 
outcome of the experiment corresponds to a unigue element of the set. An event E is 
a subset of a sample space S. An element in a sample space is called a sample point 
or a simple event. 


7.1.1.1 Denition of probability 


If an experiment can occur in n mutually exclusive and egually likely ways, and if 
exactly m of these ways correspond to an event Е, then the probability of E is given 
by 

P(E) = —. (7.1.1) 
If E is a subset of S, and if to each element subset of S, a non-negative number, 
called the probability, is assigned, and if E is the union of two or more different sim- 


ple events, then the probability of E, denoted P(E), is the sum of the probabilities 
of those simple events whose union is Æ. 


7.1.1.2 Marginal and conditional probability 


Suppose a sample space S is partitioned into rs disjoint subsets where the general 
subset is denoted E; N Fj (with i = 1,2,...,r and j = 1,2,...,s). Then the 
marginal probability of E; is de ned as 


8 
Р(Е;) = V P(Ein Fj), (7.12) 
1-1 
and the marginal probability of Р, is de ne das 
T 
Р(Е;) = X P(EinF,). (7.1.3) 
i=1 


The conditional probability of Е;, given that F; has occurred, is de ned as 


P(E; N F;) 


P(E; | Fj) = PS 


when P(F;) Z 0 (7.1.4) 


and that of F,, given that E; has occurred, is de ned as 


P(E;n F;) 


PUG |E) = -pE 


when Р(Е;) £ 0. (7.1.5) 
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7.1. 
1 


2 


3, 


7.1. 
1 


2 


1.3 Probability theorems 
. If is the null set, then Р(0) = 0. 


. If S is the sample space, then P(S) = 1. 


If Е and F are two events, then 


P(EU F) = P(E) + P(F) — P(En F). (7.1.6) 


. If E and F are mutually exclusive events, then 


P(EU F) = P(E) + P(F). (7.1.7) 


. If E and Е” are complementary events, then 


P(E) = 1— P(E’). (7.1.8) 


. Two events are said to be independent if and only if 
PIEN F) = P(E) P(P). (7.1.9) 


The event F is said to be statistically independent of the event F if 
P(E | F) = P(E) ааа P(F | E) = P(F). 


. The events ( £1, ..., En + are called mutually independent for all combinations 
if and only if every combination of these events taken any number of times is 
independent. 


. Bayes’ rule: If (E, ..., En} are n mutually exclusive events whose union is 
the sample space S, and if E is any arbitrary event of S such that P(E) Z 0, 
then 

P(Ex) P(E | Ex) P(Ex) PE | Ex) 


P(E, | E) = man ST PIE) PE E) (7.1.10) 


. For a uniform probability distribution, 


Number of outcomes in event А 
РА---------------. 7.1.11 
(4) Total number of outcomes ( ) 


1.4 Terminology 


‚ A function whose domain is a sample space S and whose range is some set 
of real numbers is called a random variable. This random variable is called 
discrete if it assumes only a nite or denumerable number of values. It is 
called continuous if it assumes a continuum of values. 


. Random variables are usually represented by capital letters. 
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3. “па” or “114” is often used for the phrase "independent and identically 
distributed". 


4. Many probability distributions have special representations: 


(a) х2: chi-square random variable with n degrees of freedom 

(b) E(A): exponential distribution with parameter A 

(с) N(u, с): normal random variable with mean и and standard deviation с 
(d) P(A): Poisson distribution with parameter А 

(e) U[a, b): uniform random variable on the interval [a, b) 


7.1.1.5 Characterizing random variables 


The density function is de ned as follows: 


1. When X is a continuous random variable, let f(x) dx denote the probability 
that X lies in the region [x, x + da]; f(x) is called the probability density 
function. (We require f(x) > 0 and | f(x) dx = 1.) For any event E, 


P(E) = Р(Х isin E) = 10) da. (7.1.12) 


2. When X is a discrete random variable, let рь for k = 0,1,... be the proba- 
bility that X = тк (with p; > 0 and У’ „Pr = 1). Mathematically, for any 
event E, 

Р(Е) = P(Xisin E) = 5 Pk- (7.1.13) 
r, EE 
A discrete random variable can be written with the continuous density 


fl) = Za Ped (a — т). 


The cumulative distribution function, or simply the distribution function, is de- 
ned by 


NU RU Se = [zns py, in the discrete case, (7.1.14) 


i f°. f (t) dt, in the continuous case. 
Note that F(—00) = 0 and F(oo) = 1. The probability that X is between a and b is 
P(a« X <b) = Р(Х € b) - P(X € a) = F(b) — F(a). (7.1.15) 


Let g(X) be a function of X. The expected value (or expectation) of g( X), 
denoted by E [g(.X )], is de ned by 


in the discret 
Elg(X)] = по in the discrete case, (7.1.16) 


JR 9 (0) (t) dt, in the continuous case. 
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1. E[aX + bY] = aE [X] + bE [Y]. 
2. E[XY] = E[X]E[Y] if X and Y are statistically independent. 


The moments of X are de ned by ш, = E[X^]. The rst moment, ji, is 
called the mean of X; it is usually denoted by и = м) = E[X]. The centered 
moments of X are de ned by иь = E [(X — и)* |. The second centered moment is 
called the variance and is denoted by c? = жш = E [(X — p)?]. Here, g is called 
the standard deviation. The skewness is 1 = U3/0?, and the excess or kurtosis is 
72 = (ш/о) — 3. 

Using 02 to denote the variance for the random variable Z, we have 


7.1.1.6 Generating and characteristic functions 


In the case of a discrete distribution, the generating function corresponding to X 
(when it exists) is given by G(s) = Gx(s) = E[s*] = Vo prs“+. From this 
function, the moments may be found from 


ш-(82) во 


1. If cis a constant, then the generating function of c + X is s“G(s). 


(7.1.17) 


8-1 


2. If cis a constant, then the generating function of cX is G(s“). 


3. If Z = X +Y where X and Y are independent discrete random variables, 
then Gz(s) = Gx(s)Gy (в). 


4. If Y = 557.4 Xi, the {X;} are independent, and each X; has the common 
generating function G x (s), then the generating function of Y is [G x(s)]”. 


In the case of a continuous distribution, the characteristic function correspond- 
ing to X is given by Ф(@) = ЕЦ | = f°. ей f(x) ат, the Fourier transform 
of f(x). From this function, the moments may be found: u! = i7" (0). If 
Z = X +Y where X and Y are independent continuous random variables, then 
óz(t) = фх (t)óy (t). 

The cumulant function is de пей as the logarithm of the characteristic function. 
The n” cumulant, kn, is de ned as a coef cient in the Taylor series of the cumulant 


function, 


log d(t) = yo (7.1.18) 
n=0 ` 
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Note that kı = и, кә = 07, кз = из, and ка = u4 — Зиз. For a normal probability 
distribution, kn = 0 for n > 3. The centered moments in terms of cumulants are 


H2 = Ко, 
Из - Кз, 
Ha = ка + Зк2, (7.1.19) 


Hs = Ks + 10кзко, 


Ив = Kg + 15какә + 10K3 + 15x3. 


7.1.2 MULTIVARIATE DISTRIBUTIONS 
7.1.2.1 Discrete case 


The k-dimensional random variable (X 1,..., X4) is a k-dimensional discrete ran- 
dom variable if it assumes values only at a nite or denumerable number of points 
(Z1,..., Tk). De ne 

P(X, = 11, Xa = 23,..., Xy = zy) = f(z1,22,..., Tk) (7.1.20) 


for every value that the random variable can assume. The function /(ж1,...,т,)і 
called the joint density of the k-dimensional random variable. If Е is any subset of 
the set of values that the random variable can assume, then 


P(E) = P[(X1,..., Xy) isin E] = Хэн (ті,...,2 (7.1.21) 


where the sum is over all the points (11,... 2 їп E. The cumulative distribution 
function is de ne d as 


Float = у) Уу e УУ, 22223 (7.1.22) 


21<24122<79 2.<ть 


7.1.2.2 Continuous case 


The k random variables (Хі,..., Хы) are said to be jointly distributed if a function 
f exists so that /(21,...,2,) > 0 forall —00 < 2; < oo (i = 1,..., k) and so that, 
for any given event F, 


P(E) = P[(Xi, Xo,..., X4) isin E] 


EE [x Ti, 02,-.., Zk) day dra +++ day. (7.1.23) 
The function /(21,...,ть) is called the joint density of the random variables X1, 
X», ..., Xk. The cumulative distribution function is de ned as 


I = / | +] f (21, 22,..., 2g) dzg +++ dza аға. (7.1.24) 


Given the cumulative distribution function, the probability density may be found 
from 


д д д 


ТЕ S EP со ) 7:122 
f(x t9 mg) 02-05 (Bry doo SEK) ( 5) 
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7.1.2.3 Moments 


The r" moment of X; is de ned as 


Der Dagtid bas ER). in the discrete case, 
E[X!]-4 9) % | | 
fo f at }(ж\,...,жь) day +++ dx, іп ће continuous case. 
— 00 — 00 
(7.1.26) 


Joint moments about the origin are de ned as E[X 1 Х32... Ху] where ry + r2 + 
-++-+ rg is the order of the moment. Joint moments about the mean аге de ned as 
E[(X1 — и)" (Хә — рә)" (Х-шы, where >, = E[X;]. 


7.1.2.4 Marginal and conditional distributions 

If the random variables X1, ..., X, have the joint density function f(£1,..., £k), 
then the marginal distribution of the subset of the random variables, say, X 1, ..., Xp 
(with p < k), is given by 


g(21,22,..., 5) = 
Уда Оғыз Cou Sri, Ta, . .., Tk), іп the discrete case, 
со "Т оо | | (7.127) 
fo f }(ш\,...,жь) атр +++ doy, іп the continuous case. 
— 00 — 00 


The conditional distribution of a certain subset of the random variables is the 
joint distribution of this subset under the condition that the remaining variables are 
given certain values. The conditional distribution of X1, X5, ..., Xp, given Хуа, 
Xp+2 ..., Хр, is 


/(ш\,ә,...,®ь) 


(7.1.28) 
G(Zp41, Lp42, Ra 1 


h(z1,..., Sp | Xpyi,..., Le) = 
if 0(жр+1, 2p42,... xk) 70. 
The variance бу, of X; and the covariance с;з; of X; and X ; are given by 
o; = 0; = E [GG — 4], 
01) = рио) = B[(Xi — ш)(Х; — ш), 


where pj; is the correlation coef cie nt, and с; and о; are the standard deviations of 
X i and X т 


(7.1.29) 


7.1.3 RANDOM SUMS ОҒ RANDOM VARIABLES 


If T = гээн Xi, and if N is an integer-valued random variable with generating 
function G y (s), and if the {X;} are discrete independent and identically distributed 
random variables with generating function С x (s), and the {X;} are independent of 
N, then the generating function for T is Gr(s) = Gn(Gx(s)). (If the {X;} are 
continuous random variables, then or (t) = Gn (@x(t)).) Hence, 


l. UT = имих. 
2. oF = uyo% + UXON- 
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7.1.4 TRANSFORMING VARIABLES 


1. Suppose that the random variable X has the probability density function f x (x) 
and the random variable Y is de ned by Y = g(X). If g is measurable and 
one-to-one, then 


(7.1.30) 


where h(y) = 9—1 (y). 


2. If the random variables X and Y are independent and if their densities f x and 
fy, respectively, exist almost everywhere, then the probability density of their 
sum, Z — X + Y,is given by the convolution 


fz(z) — Г fx (z)fv(z — x) dz. (7.1.31) 


3. If the random variables X and Y are independent and if their densities f x and 
fy, respectively, exist almost everywhere, then the probability density of their 
product, Z = XY, is given by the formula, 


fz(z)- Г ET (=) dz. (7.1.32) 


-o |5 


7.1.5 CENTRAL LIMIT THEOREM 


If {X;} are independent and identically distributed random variables with mean u 
and nite variance g“, then the random variable 


(X Xo tc Xn) — np 
Vno 


tends (as n — oo) to a normal random variable with mean zero and variance one. 


Z= (7.1.33) 


7.1.6 INEQUALITIES 


1. Markov’s Inequality: If X is a random variable which takes only non-negative 
values, then for any a > 0, 


P(X >a) < ва 


(7.1.34) 
а 


2. Cauchy—Schwartz Inequality: Let X and Y be random variables for which 
E [X?] and E [Y?] exist, then 


(E[XY]? < E [X°] E [Y°]. (7.1.35) 
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3. One-Sided Chebyshev Inequality: Let X be a random variable with zero mean 
(i.e., E [X] = 0) and variance o°. Then, for any positive a, 


2 


Р(Х >a) < (7.1.36) 


To +а?` 
4. Chebyshev’s Inequality: Let c be any real number and let X be a random 
variable for which E [(Х — c)?] is nite. Then, for every е > 0 the following 
holds: 1 
Р(Х-с > © < —;Е[(Х—с)*]. (7.1.37) 
€ 


5. Bienaymé-Chebyshev's Inequality: If E[| X|"] < oo for all r > 0 (r not 
necessarily an integer) then, for every a > 0, 


Р(|Х| >а) < oo (7.1.38) 


6. Generalized Bienaymé-Chebyshev's Inequality: Let g(x) be a non-decreasing 
non-negative function de ned on (0, oo). Then, for a > 0, 


БШП 


: 7.1.39 
g(a) EAM 


PX > a) < 


7. Chernoff bound: This bound is useful for sums of random variables. Let У, = 
Ус, Xi where the {X;} are iid. Let M(t) = Е, [е] be the same moment 
generating function for each of the {X;}, and de ne g(t) = log M(t). Then 
(the prime in this formula denotes a derivative), 


P(Y,2ng()) < e"ls-99] — ipt» 0, 
P(Y,€ng()) < e"ls0-99] itt <o. 
8. Kolmogorov’s Inequality: Let X1, Хо,..., Xn ben independent random vari- 


ables such that E[X;] = 0 and Var(X;) = оҳ, is nite. Then, for all a > 0, 


n 2 
ei max ка + Xa ++ Xul > a) D (7.1.40) 
i21,...,n ЖУ) а 
9. Jensen’s Inequality: If E [X] exists, and if f(a) is a convex U (“convex сир”) 
function, then 
E[f(X)] > f(E[X]). (7.1.41) 
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7.1.7 AVERAGES OVER VECTORS 


Let f (n) denote the expectation of the function f as the unit vector n varies uniformly 
in all directions in three dimensions. If a, b, c, and d are constant vectors, then 
а-а = al? /3, 
(a-n)(b-n) = (a-b)/3, 
(a-n)n = a/3, 
lax nl“ = 2]aľ“ /3, 
(a x n) : (b x п) = 2a-b/3, 
(a-n)(b-n)(e-n)(d-n) = [(a- b)(c - d) + (a - c)(b - d) + (а: d)(b + c) | /15. 


(7.1.42) 


Now let f(n) denote the average of the function f as the unit vector n varies 
uniformly in all directions in two dimensions. If a and b are constant vectors, then 


ага = [a /2, 
(a - n)(b п) = (a - b)/2, (7.1.43) 
(а :п)п = а/2. 


71.8 GEOMETRIC PROBABILITY 


1. Points in a line segment: 


If A and B are uniformly and independently chosen from the interval [0, 1), 
and X is the distance between A and В (that is, X = |A — В|) then the 
probability density of X is f x (x) = 2(1 — z). 


2. Many points in a line segment: 


Uniformly and independently choose n — 1 random values in the interval (0, 1). 
This creates n intervals. 


P(x) = Probability (exactly k intervals have length larger than x) 


= (i) fu — kx]! — Ч » “) [1 — (k + 1)2]"714+ (7.1.44) 
(1 Ч Л i [1 — (k + бас}, 


1 
where s = E E 1 ‚ From this, the probability that the largest interval length 
x 


exceeds z is 


1- F(z) = (i) (1 — x)"—! — (2) (1-22)-!4..... (71,45) 
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3. 


7. 


8. 


Points in the plane: 


Assume that the number of points in any region А of the plane is a Poisson 
variate with mean AA (A is the “density” of the points). Given a x ed point P 
de ne Ri, Re, ..., to be the distance to the point nearest to P, second nearest 
to P, etc. Then 
8 
fa.(r) = 2021)“ 26-1 oA (7.1.46) 
(8-1) 


. Points in three-dimensional space: 


Assume that the number of points in any volume V is a Poisson variate with 
mean AV (A is the “density” of the points). Given a x ed point P dene Hi, 


Fi», ..., to be the distance to the point nearest to Р, second nearest to Р, etc. 
Then (4 ) P 
3 ŠAT 4 3 
= =—=З RU a, 7.1.47 
fn, (r) T (s) T € ( ) 


. Points on a checkerboard: 


Consider the unit squares on a checkerboard and select one point uniformly 
and independently in each square. The following results concern the average 
distance between points: 


(a) For adjacent squares (a black and white square with a common side) the 
mean distance between points is 1.088. 

(b) For diagonal squares (two white squares with a point in common) the 
mean between points is 1.473. 


. Points in a cube: 


Choose two points uniformly and independently within a unit cube. The dis- 
tance between these points has mean 0.66171 and standard deviation 0.06214. 
Points in an n-dimensional cube: 


Select two points uniformly and independently within a unit n-dimensional 
cube. The expected distance between the points, A (n), is 


A(1) 21 А(5) ғ: 0.87852 
А(2) ғ 0.54141 А(6) ғ 0.96895 
А(3) ~ 0.66171 А(7) = 1.05159 
А(4) я 0.77766 А(8) zx 1.12817 


Points on a circle: 


Select three points uniformly and independently on a unit circle. These points 
determine a triangle with area А. The mean and variance of this area are: 


ША = 25 s 0.4775 
27 


3 (т? - 6) 
8r? 


(7.1.48) 


сз = ~ 0.1470 
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9. Buffon’s needle problem: 


A needle of length L is placed at random on a plane on which are ruled parallel 
lines a distance D apart. If 4 < 1 then only one intersection is possible. The 
probability P that the needle intersects a line is 


2L 


ш if0<L<D 
TD 1f0<L< Рр, 
шиг р\? 2 р 
--11-4/1-1- 1—Žsin—]| if D « L. 
Тр (2) +( 2 Т) if0< D< 
(7.1.49) 


7.2 CLASSICAL PROBABILITY PROBLEMS 


7.2.1 RAISIN COOKIE PROBLEM 


A baker creates enough cookie dough for С = 1000 raisin cookies. The number of 
raisins to be added to the dough, R, is to be determined. 


1. If you want to be 99% certain that the r st cookie will have at least one raisin, 


then 1 — (£21)? = 1 — (95) > 0.99, or R > 4603. 


2. If you want to be 99% certain that every cookie will have at least one raisin, 
then P(C,R) > 0.99, where P(C, R) = CE EL, (S) -1)(C — dF. 
Hence R > 11508. 


7.2.2 GAMBLER’S RUIN PROBLEM 


A gambler starts with z dollars. For each turn, with probability р he wins one dollar, 
with probability g he loses one dollar (with p + g = 1). Gambling stops when he 
has either last z dollars (“is ruined”, the gambler holds zero dollars), or won a — z 
dollars (“gambler’s success", the gambler holds a dollars). 

If g. denotes the probability of stopping with zero dollars (“is ruined”) then 


(a/p)“ — (ч/р)* 


if 
Gipe-1 NPFS 
C= (7.2.1) 
2 5 
цог if p — g — 5. 
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For example: 


biased 04 0.6 90 100 O17 
game | 0.4 0.6 | 90 99 : 
7.2.3 CARD GAMES 
b 


If the odds are a:b against, the probability of the event is p — 7195 If the odds are 
a:b for, the probability of the event is p = —®=- 


1. Poker hands 
The number of distinct 5-card poker hands is (52) = 2,598,960. 


Hand Probability Odds against 
royal ush 1.54 x 107° —4/(07 649,739:1 
straight ush 1.39 x 1075 = 36/ (77) 72,192:1 
four of a kind 2.40 x 1074 = 624/ (22) 4,164:1 
full house 1.44 x 1078 = 3744/ (7) 693:1 
ush 1.97 x 1073 508:1 
straight 3.92 x 1078 254:1 
three of a kind 0.0211 46:1 
two pair 0.0475 20:1 
one pair 0.423 — = 1.37:1 


2. Bridge hands 
The number of distinct 13-card bridge hands is (53) = 635,013,559,600. 


In bridge, the honors are the ten, jack, queen, king, and ace of each of the four 
suits. Obtaining the three top cards (ace, king, and queen) of three suits and 
the ace, king, queen, and jack of the remaining suit is called 73 top honors. 
Obtaining all cards of the same suit is called a 73-card suit. Obtaining 12 
cards of the same suit with ace high and the 13th card not an ace is called a 
12-card suit, ace high. Obtaining no honors is called a Yarborough. 


Hand Probability Odds against 
13 top honors 6.30 x 10—12 = 4/ (1) 158,753,389,899:1 
13-card suit 6.30 x 10-1? = 4/ (8 158,753,389,899:1 
12-card suit, ace high 2.72 x 1079 367,484,698:1 
Yarborough 5.47 х 1074 1,827:1 
four aces 2.64 x 107? 378:1 
nine honors 9.51 x 107? 104:1 
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7.2.4 DISTRIBUTION OF DICE SUMS 


A common die is a cube with six faces; the faces are numbered one through six. It is 
usually unbiased, all faces are equally likely. 
When rolling two dice, the probability distribution of the sum is 


6 — |s — 7| 


Prob (sum of 5) — 36 


for2« s « 12. (7.22) 


When rolling three dice, the probability distribution of the sum is 


i 4(s — 1)(s — 2) for3< s <8 
Prob (sum of s) — 216 —s? +21s — 83 for9 < s « 14 (7.2.3) 
35 (19 — s)(20 — s) for15 < s < 18 
For two dice, the most common roll is a 7 (probability 5). For three dice, the 
most common rolls are 10 and 11 (probability 2 each). For four «ісе, Ше most 


common roll is a 14 (probability e). 


7.2.5 BIRTHDAY PROBLEM 
The probability that n people have different birthdays (neglecting February 29 18) is 


364 363 366 -n 
[Edda Se pee ЕН 7.24 
Б (55) (55) ( 365 ) Cen 
Let p, = 1 — qn. For 23 independent people the probability of at least two people 
having the same birthday is more than half (p23 = 1 — q23 > 1/2). 


n 10 20 23 30 40 50 
Pn 0.117 0.411 0.507 0.706 0.891 0.970 


That is, the number of people needed to have a 50% chance of two people having 
the same birthday is 23. The number of people needed to have a 50% chance of three 
people having the same birthday is 88. For four, ve, and six people having the same 
birthday the number of people necessary is 187, 313, and 460. 

The number of people needed so that there is a 50% chance that two people 
have a birthday within one day of each other is 14. In general, in an n-day year the 
probability that р people all have birthdays at least k days apart (so k = 1 is the 
original birthday problem) is 


probability = Ч p г. P (7.2.5) 
ж 


тр-і 
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7.3 PROBABILITY DISTRIBUTIONS 


7.3.1 DISCRETE DISTRIBUTIONS 


1. Discrete uniform distribution: If the random variable X has a probability den- 
sity function given by 


P(X = r) = f(x) = —, for = 21,72,...,2ң, (7.3.1) 


then the variable X is said to possess a discrete uniform probability distribu- 
tion. 


Properties: When 2; = 1 for? = 1, 2,..., then 


1 
Mean = u = шан : 
2 
2 
-1 
Variance = о? = © : 
12 
2 (7.3.2) 
-— n? —1 
Standard deviation = с = 127 
t 1-- nt 
Moment generating function = G(t) = guae 
n(1 — ef) 


2. Binomial distribution: If the random variable X has a probability density func- 
tion given by 


Р(Х = x) = f(x) = C) 9%(1—6)"7%, fore =0,1,...,n, (733) 


then the variable X is said to possess a binomial distribution. Note that f(x) 
is the general term in the expansion of [0 + (1 — 4)]". 


Properties: 
Mean = и = n6, 
Variance = o? = nO(1 — 6), 


Standard deviation = с = V/n4(1 — Ө), 


Moment generating function = G(t) = [bet + (1 — 0)]". 


(7.3.4) 


As n — oo the binomial distribution approximates а normal distribution with 
a mean of n@ and variance of n6(1 — 0); see Figure 7.1. 


3. Geometric distribution: If the random variable X has a probability density 
function given by 


Р(Х =z) ер =0(1—0)°-%_ їогл=1,2,3,..., (7.3.5) 
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FIGURE 7.1 


Comparison of Р(х) for a binomial distribution and the approximating normal distribution. 
Left gure is for (n = 8,0 = 0.2), right gure is for (n = 8,0 = 0.4); horizontal axis is x. 


0.3 
0.3 02 
0.2 
01 0.1 
0 0 
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then the variable X 15 said to possess a geometric distribution. 


Properties: 
1 
Mean = u = — 
H 6: 
1-0 
Variance = о? = 27 
[59 (7.3.6) 
Standard deviation = o = “ув, 
Moment generating function = G(t) = бе 
шаг EJ: 


4. Hypergeometric distribution. If the random variable X has a probability den- 
sity function given by 


for z = 1,2,3,..., min(n, k) (7.3.7) 


then the variable X is said to possess a hypergeometric distribution. 


Properties. 

kn 
Mean = u = — 
HRE ae 

| k(N — k)n(N — n) 

ue 
Variance = 0” = —ONN -1) ^ (7.3.8) 
N- A. 
Standard deviation = с = Stc 
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5. Negative binomial distribution: If the random variable X has a probability 
density function given by 


iro —8)  forz—0,12,.., 


(7.3.9) 
then the variable X is said to possess a negative binomial distribution (also 
known as a Pascal or Polya distribution). 


ge 


Properties: 


Mean = u = 5 -т, 
Variance = o? = 5 (5 _ i) = r(1 — 6) 
(7.3.10) 


1 1 — 
Standard deviation — иер s =й 
910 
Moment generating function = G(t) -0"1-11-0)е "7. 
6. Poisson distribution: If the random variable X has a probability density func- 
tion given by 


езе 
P(X — x) = f(x) = for x —0,1,2,..., (7.3.11) 


a! 


with A > 0, then the variable X is said to possess a Poisson distribution. 


Properties: 
Mean = и = A, 
Variance = o? = А, 
7.3.12 
Standard deviation = с = VA, ‘ ) 
Moment generating function = G(t) = ene c0. 
7. Multinomial distribution: If a set of random variables X1, X5, ..., Xn has a 
probability function given by 
Р(Х, = r1, Xo = X2,.. aAa = Tn) = f (21, £2,.. пн) 
n р 
62% (7.3.13) 
= м 2 
= NI] zT 
ігі 
where the 1; ) are positive integers, each 0; > 0, and 
n n 
0421 and У =N, (7.3.14) 
ic ігі 
then the joint distribution of X4, X», ..., Xn is called the multinomial distri- 
bution. Note that f (21, £2,...,£n) is a term in the expansion of (04 + 05 + 


кеб); 
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Properties: 


Mean of X; = u = N6j, 
Variance of X, = o? = N6;(1— 6;), 


Covariance of X; and X; = 9j; = – №;0;, 


(7.3.15) 


Joint moment generating function = (бей + ::: + On,e)%. 


7.3.2 CONTINUOUS DISTRIBUTIONS 


1. Uniform distribution: If the random variable X has a density function of the 


form ў 
fo oa fora < r < B, (7.3.16) 
—a 
then the variable X is said to possess a uniform distribution. 
Properties: 
Mean = u = 2 5 A 
2 
Vari Брэд (5 — a) 
ariance — g po 
— 3)? (7.3.17) 
Standard deviation = o = = 
at ебі СЯ eat 
Moment generating function = G(t) = 
(8 — ол 
: (8 = a)t ( 
= | ЭГ о--8)/2- 
(B — a)t sin | 5 е 


2. Normal distribution: ЇЇ the random variable X has a density function of the 
form 


f(a) = = 


ШУУ 
če (555) ,  for—co<a<oo, (73.18) 
270 


then the variable X is said to possess a normal distribution. 


Properties. 


Mean = p, 
2 


, 


Variance = g 
Standard deviation = о, (7.3.19) 


242 
t 
Moment generating function = G(t) = exp (ut + %-) . 
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(a) Sety = = to obtain a standard normal distribution. 


(b) The cumulative distribution function 15 


реа кез 


3. Multi-dimensional normal distribution: 


The random vector X is said to be a multivariate normal (or a multi-dimensional 
normal) if and only if the linear combination a X is normal for all vectors a. If 
the mean of X is и, and if the second moment matrix R = E [(X — p)(X — 11)"] 
is non-singular, the density function of X is 


1 1 T5-1 
f(x) = (21)1/2/detR exp EC = р) В (x— 2 ? (7.3.20) 


оо оо 
Sometimes integrals of the form I, = / ЭХ | (ХЭМ x)“ f(x) dx are 
-со —oo 
desired. De ning ар = tr(M R)^, we nd: 


1, = 1, 
1, = ai, 
I. = а? + 202, (7.3.21) 


I: = aj + бааз + баз, 
IL = aj + 12а] аә + 320103 + 1242 + 4804. 


4. Gamma distribution: ЇЇ the random variable X has a density function of the 


form 
/@) = хэр нт forÜ < r < oo (7.3.22) 
Frag ' 3 
with a > —1 and 9 > 0, then the variable X is said to possess a gamma 
distribution. 
Properties: 


Mean = u = (1 + a), 
Variance = o? = “(1 + a), 
Standard deviation = o = BVI +a 
Moment generating function = G(t) = (1 — 8t) ! ^, fort < Bot. 


(7.3.23) 


5. Exponential distribution: If the random variable X has a density function of 
the form 
e t /9 


f(x) = "E for 0 < r < oo, (7.3.24) 
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where 0 > 0, then the variable X is said to possess an exponential distribution. 


Properties: 


Mean = и = 0, 
Variance = o? = 6”, 
Б (7.3.25) 
Standard deviation = o = б, 


Moment generating function = G(t) = (1 — 8t). 


6. Beta distribution: If the random variable X has a density function of the form 


Г 2 
(а + 8 + ) 1“(1 — x)“, 
T(1 + a)T(1 + 8) 
(7.3.26) 

for0 < r < 1, where a > —1 and 9 > — 1, then the variable X is said to 


possess a beta distribution. 


fa) = B(1+a,1+6)2x“(1 — x)“ = 


Properties: 
Mean = u = di 
zx RT (7.3.27) 
1 1 
Vices hc cS ROUES eL 
(Q+a+ 8)*(3 - a 8) 

m T(2--o +r a 4r) 

th 
t about th = к= waa ч ieY 
Шыны ы SU Пёну Жа ras ЕС) 


7. Chi-square distribution: If the random variable X has a density function of 


the form 
( ) 2n /2 (n/ ) or « py « oo ( -4. ) 


then the variable X is said to possess a chi-square (x?) distribution with n 
degrees of freedom. 


Properties: 
Mean = р = п, 
Уагіапсе = о? = 2п, (7.3.29) 
Standard deviation = с = V2n. 
(a) If Y3, Y2,..., Yn are independent and identically distributed normal ran- 


n 
dom variables with a mean of 0 and a variance of 1, then у? = > Y? is 
ї=1 


distributed as chi-square with n degrees of freedom. 


(b) ЛҒұ? 2; cs 37, аге independent random variables and have chi-sguare 
distributions with n1, n», ..., ng degrees of freedom, then x x has 
a chi-squared distribution with n = DE n; degrees of freedom. 
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8. Snedecor's F -distribution. If the random variable X has a density function of 
the form 


T (23m) (my? „(m—2)/2 
f(x) = RPM ras Mr id оо, | (73.30) 


m n m n+m)/2? 
ЈЕВ) (1+ 24)! А 


then the variable X 15 said to possess a F-distribution with m and n degrees 
of freedom. 
Properties: 
n 
n—2" 
2n?(m +n — 2) 
m(n — 2)? (n — 4)" 


Mean = u = for n > 2, 


(7.3.31) 


Variance = for n > 4. 


ma/n 
1+7 


(a) The transformation w = transforms the F-density to the beta 
density. 


(b) If the random variable X has a x “-distribution with m degrees of free- 
dom, the random variable Y has a x “distribution with n degrees of free- 


X 
dom, and X and Y are independent, then F = иг 18 distributed ав an 


F -distribution with m апа n degrees of freedom. 


9. Student’s t-distribution: If the random variable X has a density function of the 
form 


r(e) 


2. (n4-1)/2? 
vns (8) (1+ 22)" 


then the variable X is said to possess а t-distribution with n degrees of free- 
dom. 


f(x) = for —oo < © < oo. (7.3.32) 


Properties. 


Mean = и = 0, 


7.3.33 
Variance = о? = i 2” for n > 2. ( ) 
nu 


(a) If the random variable X is normally distributed with mean О and vari- 
ance c?, and if Y?/o? has a x? distribution with n degrees of freedom, 


хуп 
Ү 


and if X and Y are independent, then t = is distributed as a 


t-distribution with n degrees of freedom. 
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FIGURE 7.2 


Conceptual layout of a gueue. 


Arrivals Oueue Servers Departures 
= 
— 
e — e — e — ...— e > — 
m 
K 


7.4 QUEUING THEORY 


A queue is represented as A/ B/c/ K /m/Z where (see Figure 7.2): 


1. A and B represent the interarrival times and service times: 


GI general independent interarrival time, 

G general service time distribution, 

Hy  k-stage hyperexponential interarrival or service time distribution, 
E,  Erlang-k interarrival or service time distribution, 

M © exponential interarrival or service time distribution, 

D deterministic (constant) interarrival or service time distribution. 


cis the number of identical servers. 
K is the system capacity. 

m is the number in the source. 

Z is the queue discipline: 


Sh eon. ә 


FCFS rst come, rst served (also known as FIFO: * rst in, rst out"), 
LIFO last in, rst out, 

RSS random, 

PRI priority service. 


When not all variables are present, the trailing ones have the default values, K = oo, 
m = oo, and Z is FIFO. Note that the m and Z are rarely used. 


7.4.1 VARIABLES 


]. Proportions 


(a) аһ: proportion of customers that nd n customers already in the system 
when they arrive. 
(b) dn: proportion of customers leaving behind n customers in the system. 
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(c) pa: proportion of time the system contains n customers. 


2. Intrinsic gueue parameters 


(a) A: average arrival rate of customers to the system (number per unit time). 
(b) и: average service rate per server (number per unit time), и = 1/E[T ,]. 
(c) u: traf c intensity, u = A/p. 

(d) p: server utilization, the probability that any particular server is busy, 


p — ufe = (А/ш) /с. 


3. Derived queue parameters 


(a) L: average number of customers in the system. 
(b) Lg: average number of customers in the queue. 
(c) N: number in system. 

(d) W: average time for customer in system. 

(e) Wa: average time for customer in the queue. 
(f) Т»: service time. 


4. Probability functions 


(a) /5(4): probability density function of customer's service time. 

(b) f(x): probability density function of customer's time in system. 
(c) т(2): probability generating function of рд: Tn = 20: Pnz” 

(4) то(2): probability generating pr С) the number Г the gueue. 
(е) a(s): Laplace Transform of f(x) EM о Juge das 

(f) ат(в): Laplace Transform of the service pun 


7.4.2 THEOREMS 
1. Little's law: L = AW and Lg = Мо. 


2. If the arrivals have a Poisson distribution: pn = ал. 
3. If customers arrive one at a time and are served one at a time: ay = dp. 


4. For an M/M/1 queue with p < 1, 


(a) pn = (1 — р)р", 

(b) L — p/(1— р), 

(c) Lo = p? /(1— р), 

(9) W = 1/(u — А), 

(e) Wo = p/(u — А), 

(f) x(z) = (1— p)/(1 — zp), 

(g) a(s) = (А — /(^ — n — s). 
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5. For an М/М/с queue with p < 1 (so that ил = nu for n = 1,2,...,c and 
Ln = си for n > с), 


u“ c—1 ил E 
(a) po — т ӨЗІ ; 


0 
рои" /n! for n — 0,1,...,c, 
(b) pn — a 522 
pou" /с\с for n > с, 


(c) La = pou“ p/ (1 — р)?, 
(d) Wg = Lo/A, 

(е) W = Wg --1/ш, 

(0) L= М. 


6. Pollaczek-Khintchine formula: For an М/С /1 queue with р < 1and E [T?] < oo 


(a) L= Lo p, 


(d) Lg = AW, 
(е) т(2) = ro(z)ar(A — Аг), 
@ то(г) = (1— p)(1 — z)/(a(A — Az) — z). 


7. Foran M/G/oo queue 


(а) passe. "ut inl 
(b) т(2) = exp (- (1 — z)u). 


=1 
u^ (X u* 
8. Erlang B formula: For an M/G/c/c queue, pe = E (>: x) : 
k=0 


9. Distributional form of Little’s law: For any single server system for which: (i) 
Arrivals are Poisson at rate A, (ii) all arriving customers enter the system and 
remain іп the system until served (1.е., there is no balking or reneging), (iii) the 
customers leave the system one at a time in order of arrival, (iv) for any time t, 
the arrival process after time ¢ and the time in the system for any customer 
arriving before ¢ are independent, then (here L and W do not denote averages) 


(a) т(г)- а(Хі-2)), 


(b) E[L"] = Xz- S(n, k)E ЦУУ | 
where S(n, k) is Stirling number of the second kind. For example: 


i. E[L] = АЕ [И] (Little"s law), 
ii. E[L?] = E[AW)?] + E [AW]. 
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7.5 MARKOV CHAINS 


A discrete parameter stochastic process is a collection of random variables {X (t), 
t = 0,1,2,...}. The values of X (t) are called the states of the process. The col- 
lection of states is called the state space. The values of ¢ usually represent points 
in time. The number of states is either nite or countably in nite. A discrete pa- 
rameter stochastic process is called a Markov chain if, for any set of n time points 
ty < t2 < +++ < ty, the conditional distribution of X (tn) given values for X (11), 
X (t3), ..., X(t4 1) depends only on X (tn—1). It is expressed by 


P[X(tn) € tn | X(ti) = z1,..., X(t4 1) = 24-1] 
= P[X(tn) € £n | X (tn-1) = 2-1]. (7.5.1) 
A Markov chain is said to be stationary if the value of the conditional probability 


P[X (tn41) = Un41|X (tn) = Ln] is independent of n. This discussion will be re- 
stricted to stationary Markov chains. 


7.5.1 TRANSITION FUNCTION AND MATRIX 


7.5.1.1 Transition function 


Let x and y be states and let {t,, } be time points in T = f0,1,2,... +. The transition 
function, P(x,y), 15 de ned by 


P(z,y) = Panne, y) = P[X(tn4i) =y | X(tn) = 2], tn, tn € T. 
(7.5.2) 
P(x,y) is the probability that a Markov chain in state x at time ¢,, will be in state 
y at time £441. Some properties of the transition function are that P(x,y) > 0 and 
2, P(x,y) = 1. The values of P(x, y) are commonly called the one-step transition 
probabilities. 
The function то(2) = Р(Х(0) = 2), with то(2) > 0 and У, по(х) = 1, is 
called the initial distribution of the Markov chain. It is the probability distribution 
when the chain is started. Thus, 


Р[Х (0) = $9, X 1) = 11,...,Х(п) = Ln] 
= To (Xo).Poa (z0, 21) P1,2 (31, £2) EN Бин наа а! (7.5.3) 


7.5.1.2 Transition matrix 


A convenient way to summarize the transition function of a Markov chain is by using 
the one-step transition matrix. It 15 de ned as 


Р(0,0) P(0,1) P(0,n) 
P(1,0) Р(1,1) P(1,n) 

P= : А E? : . (7.5.4) 
Pín, 0) Р(п,1) ... P(n,n) 
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De ne the n—step transition matrix by Р(") as the matrix with entries 
PO (x,y) = P[X(tm+n) = y | X (tm) = a]. (7.5.5) 


This can be written in terms of the one-step transition matrix as P (n) = pr, 
Suppose the state space is nite. The one-step transition matrix is said to be 
regular if, for some positive power m, all of the elements of P™ are strictly positive. 


THEOREM 7.5.1 (Chapman-Kolmogorov equation) 


Let P(x,y) be the one-step transition function of a Markov chain and de ne 
РО) (x,y) = 1, if x = y, and О, otherwise. Then, for any pair of non-negative 
integers, s and t, such that s +t =n, 


Р (о) = PO Р Өү), (7.5.6) 


2 


7.5.2 RECURRENCE 


De ne the probability that a Markov chain starting in state x returns to state x for 
the rst time after n steps by 


f^(z,z) = P[X (t) — z, X (tn) # m... X(t) Fe | X (to) =]. (7.5.7) 


It follows that P” (x, x) = $5, f*(a,2)P"—* (a, x). A state x is said to be recur- 
rent if $77 , f"(x,x) = 1. This means that a state x is recurrent if, after starting 
in 2, the probability of returning to it after some nite length of time is one. A state 
which is not recurrent is said to be transient. 


THEOREM 7.5.2 


A state x of a Markov chain is recurrent if and only if 355. | P” (x, x) = оо. 


Two states, x апа y, are said to communicate if, for some n > 0, P” (x,y) > 
0. This theorem implies that, if x is a recurrent state and communicates with y, 
y is also a recurrent state. A Markov chain is said to be irreducible if every state 
communicates with every other state and with itself. 

Let x be a recurrent state and de ne Т, the (return time) as the number of stages 
for a Markov chain to return to state x, having begun there. A recurrent state x is 
said to be null recurrent if E [I';] = оо. A recurrent state that is not null recurrent is 
said to be positive recurrent. 


7.5.3 STATIONARY DISTRIBUTIONS 


Let {X (t), = 0,1,2,...} be a Markov chain having a one-step transition function 
P(z,y). A function m(x) where each m(x) is non-negative, У), 7(x)P(a,y) = 
my), and У), 7(y) = 1, is called a stationary distribution. If a Markov chain has а 
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stationary distribution and lim „усо P” (x,y) = т(у) for every x, then, regardless of 
the initial distribution, то (x), the distribution of X (£4) approaches т (x) as n tends to 
in nity . When this happens, т (x) is often referred to as the steady state distribution. 
The following categorizes those Markov chains with stationary distributions. 


THEOREM 7.5.3 


Let Хр denote the set of positive recurrent states of a Markov chain. 


1. If Xp is empty, the chain has no stationary distribution. 

2. If Xp is a non-empty irreducible set, the chain has a unique stationary 
distribution. 

3. If Xp is non-empty but not irreducible, the chain has an in n ite number of 
distinct stationary distributions. 


The period of a state x is denoted by d(x) and is de ned as the greatest common 
divisor of all integers, n > 1, for which P^(zr,z) > 0. If P^(x,z) = 0 for all 
n > 1, then de ne d(x) = 0. If each state of a Markov chain has d(x) = 1, the chain 
is said to be aperiodic. If each state has period d > 1, the chain is said to be periodic 
with period d. The vast majority of Markov chains encountered in practice are ape- 
riodic. An irreducible, positive recurrent, aperiodic Markov chain always possesses 
a steady-state distribution. An important special case occurs when the state space is 
nite. Suppose that X = {1,2,..., K}. Let ro = {т0(1), 70(2),..., to(K)}. 


THEOREM 7.5.4 


Let Р be a regular one-step transition matrix and то be an arbitrary vector of initial 
probabilities. Then lim, , o5 То(2)Р” = y, where УР = y, апа `у`,_у To(yi) = 1. 


7.5.3.1 Example: A simple three-state Markov chain 


A Markov chain having three states (0, 1,2} with a one-step transition matrix of 


1 (0 1 
2 2 
P= + 3 0 | is diagrammed below. 

2 2 
0 4 5 

3/4 

1/4 3/4 
1/2 (0) © 1/4 
1/2 
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The one-step transition matrix gives a two-step transition matrix 


4: 22:08 
4 8 8 

РО-рР -18 2 1 (7.5.8) 
I A эй 
16 4 16 


The one-step transition matrix is regular. This Markov chain is irreducible, and all 
three states are recurrent. In addition, all three states are positive recurrent. Since all 
states have period 1, the chain is aperiodic. The unique steady state distribution is 
т(0) = 3/11, 7(1) = 6/11, and x (2) = 2/11. 


7.54 RANDOM WALKS 


Let 7(t1),(t2),... be independent random variables having a common density 
f(x), and let £1, t2,... be integers. Let Хо be an integer-valued random variable 
that is independent of 7(t1), n(t2), ..., and X (tn) = Xo + $5; n(ti). The se- 
quence {X (1;), i = 0, 1,... + is called a random walk. An important special case is 
a simple random walk. It is de ned by 


р ify=a-1, 
P(z,y)= $r, ify=a, where p+ q +r = 1, and P(0,0) 2 p+r. 
4, ify=a+1, 
(7.5.9) 
Here, an object begins at a certain point in a lattice and at each step either stays at 
that point or moves to a neighboring lattice point. 

This one-dimensional random walk can be extended to higher-dimensional lat- 
tices. A common case is that an object can only transition to an adjacent lattice 
point, and all such transitions are equally likely. In this case, with a one- or two- 
dimensional lattice, if a random walk begins at a lattice point x, then it will return to 
that lattice point with probability 1. In this case, with a three-dimensional lattice, the 
probability that it will return to its starting point is only about 0.3405. 


7.5.5 EHRENFEST CHAIN 


A simple model of gas exchange between two isolated bodies is as follows. Suppose 
that there are two boxes, Box I and Box II, where Box I contains K molecules 
numbered 1,2,..., K and Box II contains N — K molecules numbered K +1, K + 
2,..., N. A number is chosen at random from 11,2,..., №}, and the molecule with 
that number is transferred from its box to the other one. Let X (tn) be the number 
of molecules in Box I after n trials. Then the sequence {X (tn), n = 0,1,...] is a 
Markov chain with one-stage transition function of 


F у= 1 — 1, 
Praet les. у=х+1, (7.5.10) 
0, otherwise. 
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7.6 RANDOM NUMBER GENERATION 


7.6.1 METHODS OF PSEUDORANDOM NUMBER GENERATION 


In Monte Carlo applications, and other computational situations where randomness 
is required, one must appeal to random numbers for assistance. While it has been 
argued that numbers measured from a physical process known to be random should 
be used, it has been in nitely more practical to use simple recursions that produce 
numbers that behave as random in applications and with respect to statistical tests 
of randomness. These are so-called pseudorandom numbers and are produced by 
a pseudorandom number generator (PRNG). Depending on the application, either 
integers in some range or oating point numbers in [0, 1) are the desired output from 
a PRNG. Since most PRNGs use integer recursions, a conversion into integers in a 
desired range or into a oating point number in [0, 1) is required. If 2 „ is an integer 
produced by some PRNG in the range 0 € r, < M — 1, then an integer in the range 
0 < ta < N —1, with N < M, is given by y, = | Fan |. If N < M, then 
Yn = Tn (mod N) may be used. Alternately, if a oating point value in [0, 1) is 
desired, let yn = z4/M. 


7.6.1.1 Linear congruential generators 


Perhaps the oldest generator still in use is the linear congruential generator (LCG). 
The underlying integer recursion for LCGs is 


X4 = at» —1 +b (mod M). (7.6.1) 


Equation (7.6.1) de nes a periodic sequence of integers modulo M starting with То, 
the initial seed. The constants of the recursion are referred to as the modulus M, 
multiplier a, and additive constant b. If M = 2™, a very ef cient implementation is 
possible. Alternately, there are theoretical reasons why choosing M prime is optimal. 
Hence, the only moduli that are used in practical implementations are M = 2?" or 
the prime M = 2? — 1 G.e., M is a Mersenne prime). With a Mersenne prime or any 
modulus “close to" 2?, modular multiplication can be implemented at about twice 
the computational cost of multiplication modulo 2”. 

Equation (7.6.1) yields a sequence {ж} whose period, denoted Рег(т,), de- 
pends on М, a, and b. The values of the maximal period for the three most common 
cases used and the conditions required to obtain them are 


| © | М |Реге,)| 


Primitive root of M | Anything | Prime | M—1 
3 or 5 (mod 8) 2" 20 
1 (mod 4) 2" 2^ 


A major shortcoming of LCGs modulo a power-of-two compared with prime 
modulus LCGs derives from the following theorem for LCGs: 
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THEOREM 7.6.1 


Ре пе the following LCG sequence: £n = atn—1 + b (mod Mi). If M» divides 
М, then y, = £n (mod М») satis es Yn = ayn—1 +b (mod Mə). 


Theorem 7.6.1 implies that the k least-signi cant bits of any power-of-two modulus 
LCG with Per(z,) = 2" = M has Per(y,) = 25,0 < k < m. Since a long period 
is crucial in PRNGs, when these types of LCGs are employed in a manner that makes 
use of only a few least-signi cant- bits, their quality may be compromised. When М 
is prime, no such problem arises. 

Since LCGs are in such common usage, here is a list of parameter values men- 
tioned in the literature. The Park—Miller LCG is widely considered a minimally ac- 
ceptable PRNG. Using any values other than those in the following table may result 
in a “weaker” LCG. 


[071770 [ зое | 
75 Park—Miller 
Neave 


Oakenfull 
Oakenfull 
30269 | Wichman-Hill 


7.6.1.2 Shift-register generators 


Another popular method of generating pseudorandom numbers is using binary shift- 
register sequences to produce pseudorandom bits. A binary shift-register sequence 
(SRS) is de ned by a binary recursion of the type, 


Ln = Шү- BXLn-jo ӨС © 23-3, F< р << jk =£, (7.6.2) 


where Ф is the exclusive “ог” operation. Note that r © y = x+y (mod 2). Thus the 
new bit, £n, is produced by adding k previously computed bits together modulo 2. 
The implementation of this recurrence requires keeping the last £ bits from the se- 
quence in a shift register, hence the name. The longest possible period is equal to the 
number of non-zero ¢-dimensional binary vectors, namely 2“ — 1. 

A suf cient condition for achieving Per(z,) = 2“ — 1 is that the characteristic 
polynomial, corresponding to Equation (7.6.2), be primitive modulo 2. Since prim- 
itive trinomials of nearly all degrees of interest have been found, SRSs are usually 
implemented using two-term recursions of the form, 


Ln = frk © Tn—£, 0<%<4. (7.6.3) 


In these two-term recursions, k is the lag апа £ is the register length. Proper choice 
of the pair (£, k) leads to SRSs with Per(z,) = 2“ — 1. Here is a list with suitable 
(£, k) pairs: 


13) 015) 
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7.6.1.3 Lagged-Fibonacci generators 


Another way of producing pseudorandom numbers uses lagged-Fibonacci genera- 
tors. The term “lagged-Fibonacci” refers to two-term recurrences of the form, 


Ta = Ши ОЛ bs 0 « k « (0, (7.6.4) 


where o refers to one of the three common methods of combination: (1) addition 
modulo 2"+, (2) multiplication modulo 27”, or (3) bitwise exclusive ‘OR’ing of m- 
long bit vectors. Combination method (3) can be thought of as a special implemen- 
tation of a two-term shift-register sequence. 

Using combination method (1) leads to additive lagged-Fibonacci sequences 
(ALFSs). If т, is given by 


Ln = %n—k + £n- (mod 2"), 0 « k « £, (7.6.5) 


then the maximal period is Per(z,,) = (26 — 1)2™71. 

ALFSs are especially suitable for producing oating point deviates using the 
real-valued recursion уһ = ул—к + Уһ. (mod 1). This circumvents the need to 
convert from integers to oating point values and allows oating point hardware to 
be used. One caution with ALFSs is that Theorem 7.6.1 holds, and so the low-order 
bits have periods that are shorter than the maximal period. However, this is not nearly 
the problem as in the LCG case. With ALFSs, the 7 least-signi cant bits will have 
period (2^ — 1)27—1, so, if 18 large, there really is no problem. Note that one can 
use the table of primitive trinomial exponents to nd (£, k) pairs that give maximal 
period ALFSs. 


7.6.1.4 Non-linear generators 


A recent development among PRNGs are non-linear integer recurrences. For exam- 
ple, if in Equation (7.6.4) “о” referred to multiplication modulo 27”, then this recur- 
тепсе would be a multiplicative lagged-Fibonacci generator (MLFG), a non-linear 
generator. The mathematical structure of non-linear generators is qualitatively dif- 
ferent than that of linear generators. Thus, their defects and de cienc ies are thought 
to be complementary to their linear counterparts. 

The maximal period of a MLFG is Per(x n) = (2—1)2"!7$, a factor of 4 shorter 
than the corresponding ALFS. However, there are bene ts to using multiplication as 
the combining function due to the bit mixing achieved. Because of this, the perceived 
quality of the MLFG is considered superior to an ALFS with the same lag, £. 

We conclude by de ning two non-linear generators, the inversive congruential 
generators (ICGs), which were designed as non-linear analogs of the LCG. 


1. The implicit ICG is de ned by the following recurrence that is almost that of 
an LCG 
Ln = аъ 1 +b (mod M). (7.6.6) 


The difference is that we must also take the multiplicative inverse of x 1, 
which is de ned by Tn—1 28-1 = 1 (mod M), and = 0. This recurrence 
is indeed non-linear, and avoids some of the problems inherent in linear recur- 
rences, such as the fact that linear tuples must lie on hyperplanes. 
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2. The explicit ICG is 
Ln =an+b (mod M). (7.6.7) 


One drawback of ICGs is the cost of inversion, which is O(log, M) times the cost 
of multiplication modulo М. 


7.6.2 GENERATING NON-UNIFORM RANDOM VARIABLES 


Suppose we want deviates from a distribution with probability density function f(x) 
and distribution function F(x) = f oe Қа) du. In the following “y is 1710, 1)" 
means y is uniformly distributed on (0, 1). 

Two general techniques for converting uniform random variables into those from 
other distributions are as follows: 


1. The inverse transform method: 


If y is (0,1), then the random variable F ^! (y) will have its density equal to 
f(x). (Note that F ^! (y) exists since 0 < F(x) < 1.) 


2. The acceptance-rejection method: 


Suppose the density can be written as f(x) = Ch(a)g(x) where h(x) is the 
density of a computable random variable, the function g satis es 0 < g(x) < 1, 
and C^! = | h(u)g(u) du is a normalization constant. If т is U[0, 1), y 


has density h(a), and if x < g(y), then x has density f(a). Thus one generates 
fx, у} pairs, rejecting both if x > g(y) and returning x if x < g(y). 


Examples of the inverse transform method: 


1. Exponential distribution: The exponential distribution with rate А has f(x) = 
де” (for x > 0) and F(x) = 1 — e~>*. Thus u = F(x) can be solved to 
give x = F-Hu) = —A^!In(1 — u). If u is U[0, 1), then so is 1 — u. Hence 
x = —\~'In u is exponentially distributed with rate A. 

2. Normal distribution: Suppose the z;'s are normally distributed with density 


function f(z) — AU 2. The polar transformation then gives random 


variables r = 4/2? + 22 (exponentially distributed with А = 2) and 0 = 
tan“) (22/21) (uniformly distributed on [—2, £]). Inverting these relation- 
ships results in z; = /—2In ту cos2712 and 2 = /—2]n ту sin 2725; each 
is normally distributed when x, and x2 are U[0, 1). (This is the Box—Muller 


technique.) 


Examples of the rejection method: 


1. Exponential distribution with А = 1: 


(a) Generate random numbers {U;}*_, uniformly in [0, 1], stopping at N = 
min{n | Uy > Ua > U, 1 < Un}. 


(b) If N is even, accept that run, and go to step (c). If N is odd reject the 
run, and return to step (a). 
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(c) Set X equal to the number of failed runs plus U: (the rst random num- 
ber in the successful run). 
2. Normal distribution: 


(a) Select two random variables (V; , V2) from U[0, 1). Form R = V? + V2. 
(b) If R > 1, then reject the (Vi, V2) pair, and select another pair. 


| al 
(c) If R < 1, then z = Vi am has a N (0, 1) distribution. 


3. Normal distribution: 
(a) Select two exponentially distributed random variables with rate 1: (V; , V2). 
(b) If V5 > (V, — 1)? /2, then reject the (V; , V2) pair, and select another pair. 
(c) Otherwise, V, has а N (0, 1) distribution. 


4. Cauchy distribution: To generate values of X from f(x) = аа) on —00 < 
z < оо, 


(а) 2. ао numbers и 1, U2 (uniform оп |0, 1)), and set 
= {Л – 5 A U. — 2. 

(b) | y? + у < i then return X = Yı / Үҙ. Otherwise return to step (а). 

To generate values of X from a Cauchy distribution with parameters 0 and 0, 


B 
1) = ——— ——— ———, for —oo < x < oo, construct X as above, and 
Ка) 7 [9? + (a — 0)?] 
then use BX +9. 


7.6.2.1 Discrete random variables 


The density function of a discrete random variable that attains nitely many values 


can be represented as a vector р = (ро, D1,-- ->Pn—1>Dn) by de ning the probabili- 
ties P(x = j) = pj (for = 0,...,n). The distribution function can be de ne d by 
the vector с = (co, c1,. .., c5 1, 1), where cj = УУ ур; Given this representation 


of F(x), we can apply the inverse transform by computing 2: to be U[0, 1), and then 
nding the index j so that c; < x < суфт. In this case event 7 will have occurred. 
Examples: 


1. (Binomial distribution) The binomial distribution with n trials of mean p has 
pj = (2)p (1 — p)" 7, for j = 0,...,n 


(а) As an example, consider the result of ipping a fair coin. In 2 ips, the 
probability of obtaining (0, 1,2) heads is p = (1,2,1). Hence c = 


(1,3,1). If x (chosen from U[0,1)) turns out to be say, 0.4, then “1 


head" is returned (since + <0.4< 2). 

(b) Note that, when n is large, it is costly to compute the density and distri- 
bution vectors. When n is large and relatively few binomially distributed 
pseudorandom numbers are desired, an alternative is to use the normal 
approximation to the binomial. 
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(c) Alternately, one сап form the sum $7; , [W +p], where each u, is 
110,1). 


2. (Geometric distribution) To simulate a value from P(X = i) = p(1 — p)'^! 
log U 


log(1 — p) | 


3. (Poisson distribution) The Poisson distribution with mean A has p; = Мет /j! 
for 7 > 0. The Poisson distribution counts the number of events in a unit time 
interval if the times are exponentially distributed with rate А. Thus if the times 
% are exponentially distributed with rate A oe j will be Poisson distributed 
with mean A when УУ 9t; <1 < хэ. . Since t; = —A~! In uj, where 
u, is U[0,1), the previous equation may written as ИШ шщ > е^ > 


fori > use X =1+ | 


IE ар uj. This allows us to compute Poisson random variables by iteratively 
computing Р; = [[2., u: until P; < єг. The rst such j that makes this 
inequality true will have the desired distribution. 


Random variables can be simulated using the following table (each U and U ; is 
uniform on the interval [0, 1)): 


Distribution | Formula for deviate | for deviate 


ШООЛОН 1 


Exponential E са 1InU 


Pareto f(x) = — Ьу!“ 
Rayleigh О САНА Ee 


7.6.2.2 Testing pseudorandom numbers 


The prudent way to check a complicated computation that makes use of pseudoran- 
dom numbers is to run it several times with different types of pseudorandom number 
generators and see if the results appear consistent across the generators. The fact that 
this is not always possible or practical has led researchers to develop statistical tests 
of randomness that should be passed by general purpose pseudorandom number gen- 
erators. Some common tests are the spectral test, the equidistribution test, the serial 
test, the runs test, the coupon collector test, and the birthday spacing test. 
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7.7 CONTROL CHARTS AND RELIABILITY 


7.11 CONTROL CHARTS 


Control charts are graphical tools used to assess and maintain the stability of a pro- 
cess. They are used to separate random variation from speci c causes. Data mea- 
surements are plotted versus time along with upper and lower control limits and a 
center line. If the process is in control and the underlying distribution is normal, then 
the control limits represent three standard deviations from the center line (mean). 

If all of the data points are contained within the control limits, the process is con- 
sidered stable and the mean and standard deviations can be reliably calculated. The 
variations between data points occur from random causes. Data outside the control 
limits or forming abnormal patterns point to unstable, out-of-control processes. 

In the tables, Ё denotes the number of samples taken, 7 is an index for the sam- 
ples (i = 1...k), n is the sample size (number of elements in each sample), and 
R is the range of the values in a sample (maximum element value minus minimum 
element value). The mean is yz and the standard deviation is с. Control chart upper 
and lower control limits are denoted UCL and LCL. 


Types of control charts, their statistics, and uses 


Chart | Statistics | Statistical guantity 
ые 


| Gaussian | Average value and range 
LA 
small sample sets. 
ша 


Individual measured values 
Similar to x — R chart but single measurements are made. Used 
when measurements are expensive or dispersion of measured 
values is small. Rs = |x; — zii. 
| Binomial | Number of defective units 


ттт number of defective units in sets of x ed size. 


Charts number of defective units in sets of varying size. 


| Poisson | Number of defects 


oe number of a ws ina product of x ed size. 


| Poisson | Defect density (defects per quantity unit) 


ШЕШЕ the defect density on a product of varying size. 


um — | Binomial | Percent defective 
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үре 2 control charts апа limits (“Р” stands for parameter) 


Chart Centerline 
маг 
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[6 — [048 2534 [0 — [5978 |  — [2994 | 1135 [0540 
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[s Pos [2576 (0546 | 594 | 0.184 | 1816 1223] 0412 | 
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[35 [omo sms Гэв | 5922| 0414. 
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Abnormal Distributions of Points in Control Charts 


Abnormality 


Sequence Seven or more consecutive points on one side of the 
PS [ner ne: Denes ene ae hute 
Fewer than seven consecutive points on one side of the 
center line, but most of the points are on that side. 


e 10 of 11 consecutive points 
е 12 or more of 14 consecutive points 
е 14 or more of 17 consecutive points 


e l6ormore of 20 consecutive points 


Trend Seven or more consecutive rising or falling points. 


Approaching the limit | Two out of three or three or more out of seven 
consecutive points are more than two-thirds the 
distance from the center line to a control limit. 


Periodicity The data points vary in a regular periodic pattern. 


7.7.2 ACCEPTANCE SAMPLING 


AQL acceptable quality level 
AOQ average outgoing quality 
AOQL average outgoing quality limit (maximum value of 


AOQ for varying incoming quality) 
LTPD lot tolerance percent defective 
producer’s risk | Type I error (percentage of “good” lots rejected) 
consumer s risk | Type II error (percentage of “аа” lots accepted) 


Military standard 105 D is a widely used sampling plan. There are three general 
levels of inspection corresponding to different consumer’s risks. (Inspection level II 
is usually chosen; level I uses smaller sample sizes and level III uses larger sample 
sizes.) There are also three types of inspections: normal, tightened, and reduced. 
Tables are available for single, double, and multiple sampling. 

To use MIL-STD-105 D for single sampling, determine the sample size code 
letter from Figure 7.3. Using this sample size code letter nd the sample size and the 
acceptance and rejection numbers from the table on page 654. 


EXAMPLE Suppose that MIL-STD-105 D is to be used with incoming lots of 1,000 
items, inspection level II is to be used in conjunction with normal inspection, and an 
AOL of 2.5 percent is desired. How should the inspections be carried out? 


1. From Figure 7.3 the sample size code letter is J. 


2. From page 654, for column J, the lot size is 80. Using the row labeled 2.5 the accep- 
tance number is 5 and the rejection number 1s 6. 


3. Thus, if a single sample of size 80 (selected randomly from each lot of 1,000 items) 
contains 5 or fewer defectives then the lot is to be accepted. If it contains 6 or more 
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FIGURE 7.3 
Sample size code letters for MIL-STD-105 D. 


Lot or batch size general inspection levels 


15 

25 

50 

51 90 

91 150 

151 280 

281 500 

501 1,200 

1,201 3,200 

3,201 10,000 

10,001 35,000 

35,001 150,000 

150,001 500,000 
500,001 over 


A 
A 
B 
C 
C 
D 
E 
F 
G 
H 
J 
K 
L 
M 
N 


OoO"vZzzocom-mÁnomwmonouw» 
кОоз7ГСс- ШОО 


defectives, then the lot is to be rejected. 


7.7.3 RELIABILITY 


1. The reliability of a product is the probability that the product will function 
within speci ed limits for at least a speci ed period of time. 

2. A series system is one in which the entire system will fail if any of its compo- 
nents fail. 

3. A parallel system is one in which the entire system will fail only if all of its 
components fail. 

4. Let R; denote the reliability of the i" component. 

5. Let R, denote the reliability of a series system. 

6. Let R, denote the reliability of a parallel system. 


The product law of reliabilities states 


R, = П Ri. (77.1) 


4-1 


The product law of unreliabilities states 


Bn Па — В). (772) 
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FIGURE 7.4 
Master table for single sampling inspection (normal inspection) MIL-STD-105 D. 
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Acceptable guality level (normal inspection). 

Accept if Ac or fewer are found, reject if Re or more are found. 

Use rst sampling procedure to left. 

Use rst sampling procedure to right. If sample size eguals, or exceeds, lot or 
batch size, do 100 percent inspection. 
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7.7.4 FAILURE TIME DISTRIBUTIONS 


1. Let the probability of an item failing between times £ and t + At be f(t)At + 
o(At) as At — 0. 


2. The probability that an item will fail in the interval from 0 to t is 
t 
F(t) = 1 J (x) dr. (7.7.3) 
0 


3. The reliability function is the probability that an item survives to time % 
R(t) 21— F(t). (7.7.4) 


4. The instantaneous hazard rate, Z(t), is approximately the probability of fail- 
ure in the interval from £ to t + At, given that the item survived to time t 


170). fH 


Z(t) = Ry "ТРО: (7.7.5) 


Note the relationships: 


R(t) = e- fo Zle) dz f(t) = Z(t)e- Jo 200) dz (7.7.6) 


EXAMPLE If f(t) = ai 71011 with a > 0 and 8 > 0, the probability distribution 
function for a Weibull random variable, then the failure rate is Z(t) = ай”! and 


R(t) = еге” Note that failure rate decreases with time if В < 1 and increases with 
time if B > 1. 


7.7.4.1 Use of the exponential distribution 
If the hazard rate is a constant Z(t) = a (with a > 0) then f(t) = ae~™ (fort > 0) 
which is the probability density function for an exponential random variable. If a 
failed item is replaced with another having the same constant hazard rate a, then the 
sequence of occurrence of failures is a Poisson process. The constant 1/a is called 
the mean time between failures (MTBF). The reliability function is R(t) = e~*. 

If a series system has n components, each with constant hazard rate {a ;}, then 


R,(t) = exp (- b» a) . (TIT) 
j=l 


The MTBF for the series system is ш, 


1 
Ls = >: (7.7.8) 
гийг Би age 
If a parallel system has n components, each with identical constant hazard rate a, 


then the MTBF for the parallel system is р 


1 1 1 
p= a (14 5442). (7.7.9) 
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7.8 RISK ANALYSIS AND DECISION RULES 


Suppose knowledge of a speci c state of a system is desired, and those states can be 
delineated as (61, 05, ... }. (In a weather application the states might be rain and no 
rain.) Decision rules are actions that may be taken based on the state of a system. 
For example, in making a decision about a trip, there are the decision rules: stay 
home, go with an umbrella, and go without an umbrella. 

A loss function is a function that depends on a specic state and a decision rule. 
For example, consider the following loss function (0, а): 


Loss function data 


Possible actions System state 
91 (rain) 05 (no rain) 


Stay home ал 
Go without an umbrella а» 
Go with an umbrella Q3 


It is possible to determine the “best” decision, under different models, even without 
obtaining any data. 


1. Minimax principle 


With this principle one should expect and prepare for the worst. That is, for 
each action it is possible to determine the minimum possible loss that may be 
incurred. This loss is assigned to each action; the action with the smallest (or 
minimum) maximum loss is the action chosen. 


For the given loss function data the maximum loss is 4 for action a 1 and 5 for 
either of the actions a» or аз. Under a minimax principle, the chosen action 
would be a, and the minimax loss would be 4. 


2. Minimax principle for mixed actions 


It is possible to minimize the maximum loss when the action taken is a sta- 
tistical distribution, p, of actions. Assume that action a; is taken with proba- 
bility p; (with pı + рә + рз = 1). Then the expected loss L(0;) is given by 
L(0;) = Ea|((0;, а)| = р1ё(Ө;, a1) + pa (61, a2) + p3l(;, аз). The given loss 
function data results in the following expected losses: 


ЕТЕНЕ 


It can be shown that the minimax point of this mixed action case has to sat- 
isfy L(9,) = L(05). Solving equation (7.8.1) with this constraint leads to 
9po = 3p3. Using this and pı + pə + рз = 1 in equation (7.8.1) results in 
L(01) = 1,605) = 4 — 7p3/5. This indicates that рз should be as large as 


possible. Hence, the maximum value is obtained by the mixed distribution 


р = (2,2, 5). 
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Hence, if action az is chosen 3/8"s of the time, and action a3 is chosen 5/8"s 
of the time, then the minimax loss is equal to L = 25/8. This is a smaller loss 
than using a pure strategy of only choosing a single action. 


3. Bayes actions 


If the probability distribution of the states 101,02,... } is given by the density 
function 0(0,), then the loss has a known distribution with an expectation of 
B(a) = Ej[/(6;,a)] = V, 9(0;)4(0;, a). This quantity is known as the Bayes 
loss for action a. A Bayes action is an action that minimizes the Bayes loss. 
For example, assuming that the prior distribution is given by g(91) = 0.4 and 
g(92) = 0.6, then B(a1) = 4, B(a2) = 2, and B(a3) = 3.8. This leads to the 
choice of action a». 


A course of action can also be based on data about the states of interest. For 
example, a weather report Z will give data for the predictions of rain and no rain. 
Continuing the example, assume that the correctness of these predictions is given as 
follows: 


rainy s fno rai) 
0.8 0.1 


Predict rain 
Predict no rain 2 0.2 0.9 


That is, when it will rain, then the prediction is correct 8096 of the time. 

A decision function is an assignment of data to actions. Since there are nitely 
many possible actions and nitely many possible values of Z, the number of decision 
functions is nite. For this example there are 3? — 9 possible decision functions, 
(di, d2, ..., Ф}; they are de ned to be: 


di Ф аз d4 ds dg dy 48 dg 


Predict z;,take action | a; а» аз а а а аз а аз 

Predict z2, take action | a1. аә аз 42 а аз а аз а 
The risk function R(6,d;) is ће expected value of the loss when a speci с de- 
cision function is being used: R(0,d;) = Ez[£(9, di(Z))]. It is straightforward to 


compute the risk function for all values of {d;} and (0, +. This results in the follow- 
ing values: 


Risk function evaluation 
9) Gain) 0; (moram) 
4 4 


5 0 
2 5 
4.2 0.4 


4.8 3.6 
3.6 4.9 
2.4 4.1 
4.4 4.5 
2.6 0.5 
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This array can now be treated as though it gave the loss function in a no-data 
problem. ШЕ minimax principle for mixed action results іп the “best” solution being 


rule da for & i; S of the time and rule dg for = 10 7 s of the time. This хэв to a minimax 

loss of 77 1 . Before the data Z is received, the minimax loss was “>. Hence, the data 
<< » 25 40 _ 105 

Z is Wort T — тт = 73g іп using the minimax approach. 


The regret function (also called the opportunity loss function) r(0, a) is the loss, 
£(0, a), minus the minimum loss for the given 9: r(9,a) = £(0,a) — шіп, £(0, b). 
For each state, the least loss is determined if that state were known to be true. This is 
the contribution to loss that even a good decision cannot avoid. The quantity r(0, a) 
represents the loss that could have been avoided had the state been known—hence 
the term regret. 

For the given loss function data, the minimum loss for 9 = 0, is 2, and the 
minimum loss for 0 — 0» is 0. Hence, the regret function is 


ш 91 (rain) 02 (no rain) 


НЕННЕ 
Most of the computations performed for а loss function could also be performed 


with the risk function. If the minimax principle is used to determine the “best” action, 
then, in this example, the “best” action is a2. 


7.9 STATISTICS 


7.9.1 DESCRIPTIVE STATISTICS 


1. Sample distribution and density functions 


(a) Sample distribution function: 


1 n 
= – Уц x — ci) (7.9.1) 
4-1 


2) 


where u(x) is the unit step function (or Heaviside function) de ne d by 
u(x) = 0 for x < 0 and u(x) = 1 for x > 0. 


(b) Sample density function or histogram: 


А Ё(хо + (i + 1) ш) — F(zo + iw) 


f(z) = (7.9.2) 


10 


for x € [ro + iw, xo + (i + 1)ш). The interval [zo + iw, xo + (i + Иш) 
is called the i bin, w is the bin width, and f; = F(zo + (i + 1)w) — 
Е(х0 + iw) is the bin frequency. 
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2. Order statistics and guantiles: 


(a) Order statistics are obtained by arranging the sample values (£1,... „tn | 
in increasing order, denoted by 


za) <2о) S: S Ein) (7.9.3) 
1. х1) and z(4j are the minimum and maximum data values, respec- 
tively. 
ii. For? = 1,...,n, 2(4) is called the 1" order statistic. 


(b) Quantiles: If 0 < р < 1, then the quantile of order р, £y, is de ned as 
the p(n + 1)" order statistic. It may be necessary to interpolate between 
successive values. 


i. If p = 9/4 for j = 1, 2, or 3, then 6i is called the j" quartile. 
ii. If p = j/10 for j 2 1,2,...,9, then Ei is called the j" decile. 
iii. If p = 7/100 for j = 1,2,...,99, then © is called the 3% 
percentile. 


3. Measures of central tendency 


(a) Arithmetic mean: 


70 . 4. 
z--y g; 2237 77 (7.9.4) 


(b) a-trimmed mean: 


n—k—1 
Е 1 
Eo = 51-25) (в — r) (zii) + Z(n—k)) + Ж 2 , 


i=k+2 
(7.9.5) 
where k = |an] is the greatest integer less than or equal to an, and 
т = an — К. Ifa = 0 then z, = T. 


(c) Weighted mean: If to each x; is associated a weight ш; > 0 so that 
n n 
Уш =1, then Fy = 9 шұ. (7.9.6) 
121 1-1 


(4) Geometric mean: 


1 


G.M. = (Ii J = (£122: En)” . (7.9.7) 
1-1 
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(е) Harmonic mean: 
n n 
n 1 01 1 T 
v x ber EO 


121 z; Zn 


H.M. = (7.9.8) 


(0) Relationship between arithmetic, geometric, and harmonic means: 
Н.М. < С.М. < т (7.9.9) 


with eguality holding only when all sample values аге egual. 


(g) The mode is the data value that occurs with the greatest freguency. Note 
that the mode may not be unigue. 


(h) Median: 
i. If n is odd and n = 2k + 1, then M = 2р). 
ii. If n is even and n = 2k, then M = (Z (x) + z(x41))/2. 


(1) Midrange: 


+ 
ni A (7.9.10) 
4. Measures of dispersion 
(a) Mean deviation or absolute deviation: 
1< 1< 
M.D. — „е —т|, о АР. = =): MI. 
= 12 
(7.9.11) 


(b) Sample standard deviation: 


(а) Root mean square: R.M.S. — 


(e) Sample range: түү) — X(1)- 

(0) Interquartile range: бз = &. 

(g) The quartile deviation or semi-interquartile range is one half the interquar- 
tile range. 


5. Higher-order statistics 


1 n 
(a) Sample moments: mi = — 5 48. 
n 
i21 
(b) Sample central moments, or sample moments about the mean: 
1 n 
m=- У (m -7)*. (1.9.13) 


4-1 
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7.9.2 STATISTICAL ESTIMATORS 
7.9.2.1 De nitions 


1. A function of a set of random variables is a statistic. It is a function of ob- 
servable random variables that does not contain any unknown parameters. A 
statistic is itself an observable random variable. 


2. Let 0 be a parameter appearing in the density function for the random variable 
X. Suppose that we know a formula for computing an approximate value 0 


of 0 from a given sample {x1,...,2,} (call such a function g). Then @ = 
4(41,72,...,“ғ) сап be considered as a single observation of the random 
variable Ө = g(X1, X5,..., Xn). The random variable © is an estimator for 


the parameter 0. 


3. A hypothesis is an assumption about the distribution of a random variable X. 
This may usually be cast into the form 9 € Oo. We use Ho to denote the null 
hypothesis and Н} to denote an alternative hypothesis. 


4. In signi сап ce testing, a test statistic T = T(X1,..., Xn) is used to reject 
Ho, or to not reject Ho. Generally, if T € C, where C is a critical region, then 
Но is rejected. 


5. A type I error, denoted a, is to reject Но when it should not be rejected. A 
type II error, denoted ©, is to not reject Но when it should be rejected. 


6. The power of a test is n = 1 — fl. 


[___ LLL = 
: True decision. Type II error. 
Probability is 1 — a Probability is д 


: Type I error. True decision. 
Probability is a Probability 187) = 1 — д 
7.9.2.2 Consistent estimators 


Let Ө = g(X1, Xo,..., Xn) be an estimator for the parameter 0, and suppose 
that g is de ned for arbitrarily large values of n. If the estimator has the property, 
Е[(Ө — 6)?] — 0, as n — оо, then the estimator is called a consistent estimator. 


1. A consistent estimator is not unique. 
2. A consistent estimator may be meaningless. 
3. A consistent estimator is not necessarily unbiased. 
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7.9.2.3 Efcient estimators 
An unbiased estimator © — 9(X1,X2,...,Xn) for a parameter 0 is said to be ef - 


cient 1f 1t has nite variance (E (6 - ө)? < оо) and if there does not exist another 


estimator Ө* = g*(X1, Хо,..., Xn) for 0, whose variance is smaller than that of 
©. The ef cien cy of an unbiased estimator is the ratio, 


Cramer-Rao lower bound 
Actual variance 


The relative ef cien cy of two unbiased estimators is the ratio of their variances. 


7.9.2.4 Maximum likelihood estimators (MLE) 


Suppose X is a random variable whose density function is /(т;0), where 0 = (01, 


.., 0r). If the independent sample values 11, ..., £n are obtained, then de ne the 
likelihood function as L = [[7 ц f (ai; Ө). The MLE estimate for 8 is the solution of 
the simultaneous equations, 58 = 0, fori =1,...,r. 

1. A MLE need not be consistent. 

2. А MLE may not be unbiased. 

3. A MLE need not be unique. 

4. If a single suf cient statistic Т exists for the parameter 0, the MLE of 0 must 


be a function of T. 
5. Let Ө be a MLE of 0. If r(-) is a function with a single-valued inverse, then a 


MLE оғт(0) is т(Ө). 
De ne т = У? 4 Xi/n and S? = 37 (Xi — z)? /n (note that S Z s). Then: 
Distribution Estimated MLE estimate 
parameter of parameter 


Exponential E(A) 
Exponential E(A) 


Normal N (u, с) 
Normal N (u, о) 
Poisson P(X) 

Uniform U (0, 6) 


7.9.2.5 Method of moments (MOM) 


Let ( Xj) be independent and identically distributed random variables with density 
f (2:0). Let u,(0) = E[X7] be the r" moment (if it exists). Let m; = 2 У? a? 
be the r sample moment. Form the k equations, u’, = m/,, and solve to obtain an 
estimate of 0. 


1. MOM estimators are not necessarily uniquely de пей. 
2. MOM estimators may not be functions of suf cient or complete statistics. 
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7.9.2.6 Suf cient statistics 


A statistic G = 4(Х1,..., X4) is called a suf cien t statistic if, and only if, the 
conditional distribution of Н, given G, does not depend on @ for any statistic Н = 
h(X1,..., Xn). 

Let {X;} be independent and identically distributed random variables, with den- 
sity f (7: 9). The statistics (61,..., С, аге said to be jointly suf cien t statistics if, 
and only if, the conditional distribution of X1, X5,..., Xn given Сі = g1, G1 = go, 

., Gr = gr does not depend on 0. 


1. A single suf cient statistic may not exist. 


7.9.2.7 UMVU estimators 


A uniformly minimum variance unbiased estimator, called a UMVU estimator, is 
unbiased and has the minimum variance among all unbiased estimators. 
De ne, as usual, т = У)? , X;/n and s? = 357 (X; — z)?/(n — 1). Then: 


Distribution Estimated | UMVU estimate | Variance of 
parameter of parameter estimator 
Exponential E(A) 
Exponential E(A) 


Normal N (р, о) 


Normal N (р, с) 


Poisson P(A) 


Uniform U (0, 0) 


7.9.2.8 Unbiased estimators 
An estimator g( X4, X»,..., Xn) for a parameter 0 is said to be unbiased if 


E[g( X1, X2,..., X4)] = 6. (7.9.14) 


]. An unbiased estimator may not exist. 

2. An unbiased estimator is not unique. 

3. An unbiased estimator may be meaningless. 

4. An unbiased estimator is not necessarily consistent. 
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7.9.3 CRAMER-RAO BOUND 


Тһе Cramer-Rao bound gives a lower bound on the variance of an unknown un- 
biased statistical parameter, when n samples are taken. When the single unknown 
parameter is 6, 
1 1 
а (0) > Тэхи С ТЕТІ аа (7.9.15) 
—nE [Fp log f(1:0)] mE ГЕ log f (x; 0)) | 


EXAMPLES 


1. For a normal random variable with unknown mean 0 and known variance 9“, the den- 
2 
sity is /(2:0) = —— exp (- 2-0 j: Hence, & log f(z;0) = (a — 6)/о?. The 


V2T0 2 > 00 
computation 
2 со 2 
— — ЕНСЕ 1 
Е Е 2) | =] (x 2 e € 0)? /20? dx = = 
с юу с 270 с 


results in о7(6) > =; 
2. For a normal random variable with known mean „ and unknown variance @ = c, the 
2 
density is /(2:0) = Tap ехр (5:95). Hence, Z5 log f(a; 09) = ((х = u)“ — 


28) /(20)?. The computation E [sae] = уут = уут results in o? (0) > 20*/n. 


3. Fora Poisson random variable with unknown mean 0, the density is f (1: 9) = 07е7%/т!. 


Hence, 2, log /(4:50) = 2/0 — 1. The computation 


E (6 = y = ` (5 - Ü шэн S ; results in e? (0) > 6/n. 


7.9.4 ORDER STATISTICS 


When {X;} are n independent and identically distributed random variables with 
the common distribution function Fx (ж), let Z be the m“ largest of the values 
(m = 1,2,...,n). Hence Z, is the maximum of the n values and 2, is the minimum 
of the n values. Then 


Fz,,(x) = > R [Fx (®)]! [1 — Fx (z)]^ 5. (7.9.16) 
Hence 
Pale) = [PEG , Мәсе) = n [Fx (T fx (2), (7.9.17) 
Етма(2) =1—[1— Ех()|", (ет Ех(2077! fx(z). (7.9.18) 
The expected value of the i" order statistic is given by 


n! 


E lt] = т 01 


f rf(r)F^ (xz) — F(x)! dr. (79.19) 
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7.9.4.1 Uniform distribution: 
If X is uniformly distributed on the interval [0, 1) then 


т! 


Е(>у|- ЖТ СЙ / z'(1— z)^- dz. (7.9.20) 


The expected value of the largest of n samples is ; the expected value of the least 


mH 
of n samples is 


cd. 
n+1" 
7.9.4.2 Normal distribution: 


The following table gives values of E [500] for а standard normal distribution. Miss- 
ing values (indicated by a dash) may be obtained from E | со) | = —E | сүв) | : 


ere ELEM | Ж 
0.5642 | 0.8463 | 1.0294 


0. 0000 0. 2016 0. 3527 


EXAMPLE Ifa person of average intelligence takes ve intelligence tests (each test hav- 
ing a normal distribution with a mean of 100 and a standard deviation of 20), then the 
expected value of the largest score is 100 + (1.1630) (20) ғ 123. 


7.9.5 CLASSIC STATISTICS PROBLEMS 


7.9.5.1 Sample size problem 
Suppose that a Bernoulli random variable 1s to be estimated from a sample. What 
sample size n is reguired so that, with 99% certainty, the error is no more than e — 5 
percentage points (i.e., Prob(| — pl < 0.05) > 0.99)? 

If an a priori estimate of p is available, then the minimum sample size is np = 
22 jap(1 — р)/е?. If no a priori estimate is available, then nn = zá ja /4e? > ny. For 
the numbers above, n > ny, = 664. 


7.9.5.2 Large scale testing with infreguent success 


Suppose that a disease occurs in one person out of every 1000. Suppose that a test for 
this disease has a type I and a type II error of 1% (that is, a = 8 = 0.01). Imagine 
that 100,000 people are tested. Of the 100 people who have the disease, 99 will be 
diagnosed as having 1t. Of the 99,900 people who do not have the disease, 999 will 
be diagnosed as having it. Hence, only тш з 9% of the people who test positive 
for the disease actually have it. 
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7.10 CONFIDENCE INTERVALS 


A probability distribution may have one or more unknown parameters. A con dence 
interval 1s an assertion that an unknown parameter lies in a computed range, with a 
speci ed probability. Before constructing a con den ce interval, rst select a con - 
dence coef cien t, denoted 1 — a. Typically, 1 — a = 0.95, 0.99, or the like. The 
de nition s of za, ta, and X2 are in Section 7.14.1 on page 695. 


7.10.1 CONFIDENCE INTERVAL: SAMPLE FROM ONE 
POPULATION 


The following con d ence intervals assume a random sample of size n, given by 
121,79, егесі ин» 
1. Find mean и of the normal distribution with known variance c“. 
(a) Determine the critical value 2/2 such that Ф (ža /2) = 1 — a/2, where 
© (z) is the standard normal distribution function. 
(b) Compute the mean z of the sample. 
(c) Compute k = z4/5c / /n. 
(d) The 100(1—a) percent con dence interval for u is given by [x — k, x 4- k]. 


2. Find mean у of the normal distribution with unknown variance ø °. 
(a) Determine the critical value їг such that F (£,/5) = 1 — a/2, where 
Е(-) is the t-distribution with n — 1 degrees of freedom. 
(b) Compute the mean 7 and standard deviation s of the sample. 
(c) Compute k = t4 /55/ n. 
(d) The 100(1—a) percent con dence interval for u is given by [x — k, x 4- k]. 


3. Find the probability of success p for Bernoulli trials with large sample size. 


(a) Determine the critical value za у2 such that © (24/2) = 1 — a/2, where 
© (z) is the standard normal distribution function. 

(b) Compute the proportion p of “successes" out of n trials. 

f(1 — p) 
— 

(d) The 100(1—a) percent con dence interval for pis given by [p — k, + k]. 


(c) Compute k = 24/2 


4. Find variance с? of the normal distribution. 
(a) Determine the critical values x? /з and A уз such that Р (х j2) = 


1 — a/2 and F (428) = @/2, where F (z) is the chi-sguare distri- 
bution function with n — 1 degrees of freedom. 
(b) Compute the standard deviation s. 
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—1)s? —1)s? 
(c) Compute k1 = ave and ky = аа 
a/2 X1-a/2 
(d) The 100(1 — a) percent con den ce interval for a? is given by [ki , ә]. 


(е) The 100(1 — a) percent con d ence interval for the standard deviation с 


is given by | Ёл, Vk2]. 


5. Find quantile č, of order p for large sample sizes. 


(a) Determine the critical value z /2 such that © (ža /2) = 1 — a/2, where 
© (z) is the standard normal distribution function. 
(b) Compute the order statistics z(1) 22), . - - > (п). 


(c) Compute k1 — [пр = 2/2 np(1 -р)| ала 


k2 = D Zo Ja V np(1 =p]. 


(d) The 100(1—a) percent con dence interval for £ is given by ЕТ ў sts] ; 


6. Find median M based on the Wilcoxon one-sample statistic for a large sample. 


(a) Determine the critical value za у> such that © (24/2) = 1 — a/2, where 
© (z) is the standard normal distribution function. 
(b) Compute the order statistics w (1), w(2),---, шм) ofthe N = n(n —1)/2 
averages (ж; + 2;) /2,for1 << j <n. 
N 20/2 N N žaj2 Ň 
(c) Compute k -|3 -4T and ky = | — + ; 
MEM ORE S КИМЕ 


(d) The 100(1—a) percent con dence interval for M is given by [weer 5 Wks) | Р 


7.10.2 CONFIDENCE INTERVAL: SAMPLES FROM TWO 


POPULATIONS 
The following con den ce intervals assume random samples from two large popula- 
tions: one sample of size n, given by {x1,22,...,2%n}, and one sample of size m, 


given by 191,99. ee mb 


1. Find the difference in population means и„ and uy from independent samples 
with known variances 02 and 02. 


(a) Determine the critical value 2 у> such that © (24/2) = 1 — a/2, where 
Ф (z) is the standard normal distribution function. 
(b) Compute the means 7 and y. 
c2 оў 
(c) Compute k = 24/2 p + m 
(d) The 100(1 — a) percent con d ence interval for juz — ру is given by 


[x — 9) – k, (xz —y) + k]. 
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2. Find the difference in population means и and uy from independent samples 
with unknown variances 02 and 02. 


(a) Determine the critical value 2 у> such that © (24/2) = 1 — a/2, where 
Ф (z) is the standard normal distribution function. 
(b) Compute the means 7 and y, and the standard deviations 8 „ and sy. 
2 82 
(c) Compute k = 24/2 52 +. 
n m 
(d) Тһе 100(1 — a) percent con d ence interval for juz — ру is given by 


(2—7) —k, (z - 7) + k]. 


3. Find the difference in population means и„ and jj, from independent samples 


with unknown but equal variances 97 = ту. 


(a) Determine the critical value ťa уә such that F (ta /2) = 1— a/2, where 
Е(-) is the t-distribution with n + m — 2 degrees of freedom. 

(b) Compute the means z and y, the standard deviations s; and sy, and the 
pooled standard deviation estimate, 


= 2 = 2 
"Р Mae Dene ird (7.10.1) 


n+m—-2 
[1 1 
(c) Compute k = taja 54/ — + —. 
n m 


(d) The 100(1 — a) percent con d ence interval for juz — Hy is given by 
[x — y) — k, (© - y) + k]. 


4. Find the difference in population means uy and uy for paired samples with 


unknown but equal variances 97 = 02. 


(a) Determine the critical value ťa гә such that F (ta J2) = 1 — a/2, where 
Е(-) is the t-distribution with n — 1 degrees of freedom. 

(b) Compute the mean jq and standard deviation s q of the paired differences 
Ti — Y1,%2 — U2:- 5 $n — Уп. 

(c) Compute k = t4» sq/ /n. 

(d) The 100(1 — a) percent con d ence interval for ид = He — Hy is given 
by [да — k, pa + k]. 


5. Find the difference in Bernoulli trial success rates, p; — ру, for large, indepen- 
dent samples. 


(a) Determine the critical value z ,/2 such that Ф (za J2) = 1 — a/2, where 
Ф (z) is the standard normal distribution function. 
(b) Compute the proportions р, and py of “successes” for the samples. 
5 (1—5 (1-2 
(c) Compute k = 24/2 Bele U = be) + B ( By), 
n m 
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(d) Тһе 100(1 — a) percent con den ce interval for p; — py is given by 
[Bs — Py) — k, Be — Py) + E]. 


6. Find the difference in medians M. — M, based on the Mann-Whitney-Wilcoxon 
procedure. 


(a) Determine the critical value z /2 such that Ф (zo /2) = 1 — a/2, where 
© (z) is the standard normal distribution function. 

(b) Compute the order statistics w(1), w(»),...,w(w) of the N = nm differ- 
ences 2; — 13, forl <i <папа1 <j <m. 

(c) Compute 


nm nmín+m +1 
ky = EN + |а: = 2а/2 тзг п 
апа 
nm nm (n + m +1) 
Ко = [EF -05+ metet * 


(d) The 100(1 — a) percent con de nce interval for М, — M, is given by 
| (ar) (ka): 


7. Find the ratio of variances с? / о2, for independent samples. 


(a) Determine the critical values Ғ.,/ҙ and FI дуо such that F (Е) = 
1 — a/2 and F (Fi 24/2) = a/2, where F(-) is the F-distribution with 
m — 1 and n — 1 degrees of freedom. 

(b) Compute the standard deviations s and s, of the samples. 

(c) Compute k1 = Fr -a/2 and k2 = Коуз. 

(а) us 1000 — a) percent con den ce interval for 62/02 is given by 
ЁД 1А ; 

SU бу 


7.11 TESTS OF HYPOTHESES 


A statistical hypothesis is a statement about the distribution of a random variable. 
A statistical test of a hypothesis is a procedure in which a sample is used to deter- 
mine whether we should “reject” or “not reject" the hypothesis. Before employing a 
hypothesis test, rst select a signi c ance level a. Typically, a = 0.05,0.01, or the 
like. 
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7.11.1 HYPOTHESIS TESTS: PARAMETER FROM ONE 
POPULATION 


The following hypothesis tests assume a random sample of size n, given by {£ 1,%2,... 


1. Test of the hypothesis и = uo against the alternative и # uo of the mean of a 


normal distribution with known variance c ?: 


(a) Determine the critical value г у> such that © (24/2) = 1 — a/2, where 
Ф (z) is the standard normal distribution function. 
(b) Compute the mean z of the sample. 


(T — uo) ут. 


(d) If |z| > 2,2, then reject the бойо If |z| € 24/2, then do not reject 
the hypothesis. 


(c) Compute the test statistic z — 


2. Test of the hypothesis u = ио against the alternative u > po (or U < po) of 
2. 


the mean of a normal distribution with known variance o ^: 
(a) Determine the critical value z 4 such that 6 (za) = 1 — a, where Ф (z) 15 
the standard normal distribution function. 
(b) Compute the mean z of the sample. 


(2 — plo) уп 


(c) Compute the test statistic z — . (For the alternative u < ио, 


multiply z by —1.) 
(d) If z > za, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


3. Test of the hypothesis jj = ио against the alternative u 3 ро of the mean of a 


normal distribution with unknown variance o ?: 


(a) Determine the critical value ťa /> such that F (ta /2) = 1 — a/2, where 
Е(-) is the t-distribution with n — 1 degrees of freedom. 
(b) Compute the mean 7 and standard deviation s of the sample. 


(T = ро) ут 


(d) If |t| > уо, then reject the hypothesis. If |t] < t4», then do not reject 
the hypothesis. 


(c) Compute the test statistic t = 


4. Test of the hypothesis и = uo against the alternative и > uo (or U < ро) of 


the mean of a normal distribution with unknown variance о ?: 


(a) Determine the critical value ta such that F (ta) = 1 — a, where F(-) is 
the £-distribution with n — 1 degrees of freedom. 
(b) Compute the mean 7 and standard deviation s of the sample. 


(© — uo) уп 


(c) Compute the test statistic t = . (For the alternative и < ио, 


multiply ¢ by —1.) 
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^ 


(d) If t > ta, then reject the hypothesis. If t < ta, then do not reject the 
hypothesis. 


5. Test of the hypothesis р = po against the alternative р Z po of the probability 
of success for a binomial distribution, large sample: 


(a) Determine the critical value z,/5 such that Ф (ға /2) = 1 — a/2, where 
© (z) is the standard normal distribution function. 
(b) Compute the proportion р of “successes” for the sample. 
(c) Compute the test statistic z — a UI 
po(1—po) 
n 
(d) If |z| > za/2, then reject the hypothesis. If |z| < za уә, then do not reject 
the hypothesis. 


6. Test of the hypothesis p = po against the alternative p > po (or p « po) of the 
probability of success for a binomial distribution, large sample: 


(a) Determine the critical value z 4 such that Ф (za) = 1 — a, where Ф (z) 15 
the standard normal distribution function. 

(b) Compute the proportion р of “successes” for the sample. 

(c) Compute the test statistic z — шэн (For the alternative р < ро, 


po(1—po) 
n 


multiply z by —1.) 
(d) If z > za, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


7. Wilcoxon signed rank test of the hypothesis M = Mo against the alternative 
M # Mo of the median of a population, large sample: 


(a) Determine the critical value z,/5 such that Ф (ža /2) = 1 — a/2, where 
Ф (z) is the standard normal distribution. 

(b) Compute the quantities |x; — Ло |, and keep track of the sign of x; — Мо. 
If |z; — Mo| = 0, then remove it from the list and reduce n by one. 

(c) Order the |x; — Mo| from smallest to largest, assigning rank 1 to the 
smallest and rank n to the largest; |x; — Mo| has rank r; if it is the r» 
entry in the ordered list. In case of ties (i.e., |2; — Mo| = |2; — Mo| for 
2 or more values) assign each the average of their ranks. 


n 
(d) Compute the sum of the signed ranks R = 5 sign (x; — Mo) ri. 


i=1 
(e) Compute the test statistic z = ————————. 
n(n+1)(2n+1 
6 
(f) If |z| > 25», then reject the hypothesis. If |z| < 2.2, then do not reject 


the hypothesis. 
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8. Wilcoxon signed rank test of the hypothesis M = Mo against the alternative 
M > Mo (or M < Mo) of the median of a population, large sample: 


(a) Determine the critical value za such that 6 (za) = 1 — a, where Ф (z) 15 
the standard normal distribution. 

(b) Compute the quantities |x; — Ло |, and keep track of the sign of x; — Мо. 
If |z; — Mo| = 0, then remove it from the list and reduce n by one. 

(c) Order the |x; — Mo| from smallest to largest, assigning rank 1 to the 
smallest and rank n to the largest; |x; — Mo| has rank r; if it is the r» 
entry in the ordered list. If |z; — Mo| = |x; — Mol, then assign each the 
average of their ranks. 


n 
(d) Compute the sum of the signed ranks R = 5 sign (x; — Mo) ri. 
i=1 
(e) Compute the test statistic z = ===, (For the alternative 
n(n+1)(2n+1) 
6 
M < Mo, multiply the test statistic by —1.) 
(f) If z > za, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


9. Test of the hypothesis т? = o against the alternative o? Z 06 of the variance 
of a normal distribution: 


(a) Determine the critical values x? /з and M уз such that Р (2 ja) = 


1 — a/2 and F (danz) = a/2, where Е(-) is the chi-square distribu- 
tion function with n — 1 degrees of freedom. 

(b) Compute the standard deviation s of the sample. 

(n — 1)s? 
o ` 

(d) If x? < Xaj orx? > Хау» then reject the hypothesis. 


(c) Compute the test statistic х” = 


(e) If Xi—a/2 < ү? < Xaj? then do not reject the hypothesis. 


10. Test of the hypothesis c? = og against the alternative o? > оё (oro? < 08) 
of the variance of a normal distribution: 


(a) Determine the critical value X Q- a for the alternative o? < aa) such 
that F (х2) = 1-а (F (xi a) = a), where F() is the chi-square 
distribution function with n — 1 degrees of freedom. 

(b) Compute the standard deviation s of the sample. 

(n — 1)s? 


(c) Compute the test statistic х” = 5 


00 
(d) If x? > x2 QÊ < x1.) then reject the hypothesis. 
(e) If x? < x2 M a € x7), then do not reject the hypothesis. 
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7.11.2 HYPOTHESIS TESTS: PARAMETERS FROM TWO 


POPULATIONS 
The following hypothesis tests assume a random sample of size n, given by {£ 1, 2, ... 
Xn}, and a random sample of size m, given by {y1, y2,---;Ym}- 


1. Test of the hypothesis ш, = му against the alternative ис A и, of the means 


of independent normal distributions with known variances c 2 and о? 1 


(a) Determine the critical value z ,/2 such that Ф (Za /2) = 1 — a/2, where 
© (z) is the standard normal distribution function. 
(b) Compute the means, 7 and 7, of the samples. 


(c) Compute the test statistic z = TM ыс. M 
aa 
n m 
(d) If |z| > z4/», then reject the hypothesis. If |z| < 24/2, then do not reject 


the hypothesis. 


2. Test of the hypothesis и = uy against the alternative и > py (OF fig < Hy) 
of the means of independent normal distributions with known variances т? 
and 02: 


(a) Determine the critical value z 4 such that Ф (za) = 1 — a, where Ф (z) 15 
the standard normal distribution function. 
(b) Compute the means z and y of the samples. 


(c) Compute the test statistic z = . (For the alternative и < Hy, 
multiply z by —1.) 

(d) If z > za, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


3. Test of the hypothesis и; = иу against the alternative jj; A Hy of the means 
of independent normal distributions with unknown variances с 2 and 02, large 
sample: 


(a) Determine the critical value z у> such that © (24/2) = 1 — a/2, where 
Ф (z) is the standard normal distribution. 
(b) Compute the means, x and у, and standard deviations, 82 апа 82, of the 


samples. _ 
(с) Compute the test statistic z = LM 5 
2 
TES 
(d) If |z| > za/2, then reject the hypothesis. If |z| < 24/2, then do not reject 


the hypothesis. 


4. Test of the hypothesis и = иу against the alternative py > шу (Or Uz < Hy) 
of the means of independent normal distributions with unknown variances, c 2 
and сз, large sample: 
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(a) Determine the critical value z 4 such that Ф (za) = 1 — a, where Ф (z) 15 
the standard normal distribution function. 

(b) Compute the means, 2 and у, and standard deviations, 82 апа $25 of the 
samples. d 

(c) Compute the test statistic z — шы . (For the alternative и < Hy, 
multiply z by —1.) 

(d) If z > za, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


5. Test of the hypothesis ш, = му against the alternative p A и, of the means 


of independent normal distributions with unknown variances c 2 = о2 à 
(a) Determine the critical value е, /> such that F (£,/5) = 1 — a/2, where 
Е(-) is the ¢-distribution with n + m — 2 degrees of freedom. 


(b) Compute the means, 2 and у, and standard deviations, 82 and 92, of the 


samples. ЗҮ 
(c) Compute the test statistic t = шй, 
(n-li)s$t(m-1)s$ [111 
n+m—2 n эр m 
(d) If |t| > t4 /», then reject the hypothesis. If |t| < ta /2, then do not reject 


the hypothesis. 


6. Test of the hypothesis и = и, against the alternative и; > py (or uz < 
Шу) of the means of independent normal distributions with unknown variances 
оо 

(a) Determine the critical value ta such that F (ta) = 1 — a, where F(-) is 

the ¢-distribution with n + m — 2 degrees of freedom. 


(b) Compute the means, 2 and у, and standard deviations, 82 апа 82, of the 


samples. 
(c) Compute the test statistic t = = ae SS 1-4 (For the 
(n—1)52 +(m—1)sy [1 ү 1 
n+m—2 n 28 т 


alternative ux < uy, multiply t by —1.) 
(d) If t > ta, then reject the hypothesis. If t < ta, then do not reject the 
hypothesis. 


7. Test of the hypothesis ш, = му against the alternative ис A и, of the means 
of paired normal samples: 


(a) Determine the critical value ta/2 so that F (ta J2) -1-а/2, where F (-) 
is the £-distribution with n — 1 degrees of freedom. 
(b) Compute the mean, jig, and standard deviation, sq, of the differences 
21- Y1, T2 — U2:- -Tn — Уп. 
дам! 
84 ! 


(c) Compute the test statistic t = 
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(d) If |t| > ta/2, then reject the hypothesis. If |t| < ta уо, then do not reject 
the hypothesis. 


8. Test of the hypothesis jz, = py against the alternative и, > pty (or шь < Hy) 
of the means of paired normal samples: 


(a) Determine the critical value tą so that F (ta) = 1— a, where F(-) is the 
t-distribution with n — 1 degrees of freedom. 
(b) Compute the mean, jig, and standard deviation, sq, of the differences 


21- 01,22 — )92,...,2һ- уп. 
fan 
Sd 


(c) Compute the test statistic t = . (For the alternative py < Hy, 


multiply t by —1.) 
(d) Ift > ta, then reject the hypothesis. If t < ta, then do not reject the 
hypothesis. 


9. Test of the hypothesis p; = py against the alternative p; # py of the proba- 
bility of success for a binomial distribution, large sample: 


(a) Determine the critical value z,/, such that © (24/2) = 1 — a/2, where 
Ф (z) is the standard normal distribution function. 
(b) Compute the proportions, ф and py, of “successes” for the samples. 
(c) Compute the test statistic z — — S Pr 
Ďe (1—p2) Du (1—py) 
n ag m 
(d) If |z| > za/2, then reject the hypothesis. If |z| < 24/2, then do not reject 
the hypothesis. 


10. Test of the hypothesis p; = p, against the alternative р, > py (or p; < py) of 
the probability of success for a binomial distribution, large sample: 


(a) Determine the critical value z 4 such that Ф (za) = 1 — a, where Ф (z) 15 
the standard normal distribution function. 
(b) Compute the proportions, ф and py, of “successes” for the samples. 
Ďa Vx Dy 
Йе (1— pz) + By (1 —py) 
m 


n 


(c) Compute the test statistic z — . (Multiply it by 
—1 for the alternative p, < py.) 

(d) If z > za, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


11. Mann-Whitney-Wilcoxon test of the hypothesis М, = M, against the alter- 
native M; # M, of the medians of independent samples, large sample: 


(a) Determine the critical value 2/2 such that © (24/2) = 1 — a/2, where 
Ф (z) is the standard normal distribution. 

(b) Pool the N = m + n observations, but keep track of which sample the 
observation was drawn from. 
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(c) Order the pooled observations from smallest to largest, assigning rank 1 
to the smallest and rank N to the largest; an observation has rank r; if 
it is the гї entry in the ordered list. If two observations are equal, then 
assign each the average of their ranks. 

(d) Compute the sum of the ranks from the rst sample Tz. 


_ m(N-1) 
(e) Compute the test statistic z — хэлэжэ d 
mn( N+1 
12 
(f) If [z] > za/2, then reject the hypothesis. If |z| < 2дуэ, then do not reject 


the hypothesis. 


12. Mann-Whitney-Wilcoxon test of the hypothesis М, = M, against the alter- 
native М, > M, (or M, < My) of the medians of independent samples, large 
sample: 


(a) Determine the critical value z 4 such that Ф (za) = 1 — a, where Ф (z) 15 
the standard normal distribution. 

(b) Pool the N = m + n observations, but keep track of which sample the 
observation was drawn from. 

(c) Order the pooled observations from smallest to largest, assigning rank 1 
to the smallest and rank N to the largest; an observation has rank r; if 
it is the гї entry in the ordered list. If two observations are equal, then 
assign each the average of their ranks. 

(d) Compute the sum of the ranks from the rst sample 7,. 


Ши N+1 
(e) Compute the test statistic z = сез (For the alternative М, < 


mn(N-41) 
V 12 
My, multiply the test statistic by —1.) 
(f) If |z| > za, then reject the hypothesis. If |z| < za, then do not reject the 
hypothesis. 


13. Wilcoxon signed rank test of the hypothesis М, = M, against the alternative 
М, # M, of the medians of paired samples, large sample: 


(a) Determine the critical value z,/5 such that © (25 /2) = 1 — a/2, where 
Ф (z) is the standard normal distribution. 

(b) Compute the paired differences d; = x; — y;, fori = 1,2,...,n. 

(c) Compute the quantities |d;| and keep track of the sign of d;. If d; = 0, 
then remove it from the list and reduce n by one. 

(d) Order the |d;| from smallest to largest, assigning rank 1 to the smallest 
and rank n to the largest; |d;| has rank r; if it is the гї entry in the ordered 
list. In case of ties (i.e., |d;| = |d;| for 2 or more values) assign each the 
average of their ranks. 


n 
(e) Compute the sum of the signed ranks Ё = 5 sign (dj) ri. 
m 


R 
n(n+1)2n+1) | 
V 6 


(f) Compute the test statistic z = 
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(g) If |z| > 24/2. then reject the hypothesis. If |z| < 24/2, then do not reject 
the hypothesis. 


14. Wilcoxon signed rank test of the hypothesis М, = M, against the alternative 
М, > M, (or М, < My) of the medians of paired samples, large sample: 


(a) Determine the critical value z 4 such that Ф (za) = 1 — a, where Ф (z) 15 
the standard normal distribution. 

(b) Compute the paired differences d; = x; — yi, for? = 1,2,...,n. 

(c) Compute the quantities |d;| and keep track of the sign of d;. If d; — 0, 
then remove it from the list and reduce n by one. 

(d) Order the |d;| from smallest to largest, assigning rank 1 to the smallest 
and rank n to the largest; |d;| has rank r; if itis the гї entry in the ordered 
list. In case of ties (i.e., |d;| = |d;| for 2 or more values) assign each the 
average of their ranks. 


n 
(e) Compute the sum of the signed ranks R = 5 sign (dj) ri. 
i=l 
(f) Compute the test statistic 2 = ————————. (For the alternative 
n(n+1)(2n+1 
V 6 
М, < My, multiply the test statistic by — 1.) 
(g) If z > za, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


CUR КҮҮ, : 2 2 2 2 
15. Test of the hypothesis 0; = о, against the alternative с; # cy (oro; > о;у) 
of the variances of independent normal samples: 


(a) Determine the critical value Fa гә (Fa for the alternative єў? > 02) such 
that F (Faj2) = 1— a/2 (F (Fa) = 1- o), where F(-) is the F- 
distribution function with n — 1 and m — 1 degrees of freedom. 

(b) Compute the standard deviations s апа s, of the samples. 


(ЖЕ 


шоо 8 
(c) Compute the test statistic F = 
8 


. (For the two-sided test, put the larger 


enh 


value in the numerator.) 
(d) If F > Faj2 (F > Fa), then reject the hypothesis. If F < Fa (F < 
Fa), then do not reject the hypothesis. 


7.11.3 HYPOTHESIS TESTS: DISTRIBUTION OF A 
POPULATION 


The following hypothesis tests assume a random sample of size n, given by 
[21,22,..., t4. 


]. Run test for randomness of a sample of binary values, large sample: 
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(a) Determine the critical value z ә such that Ф (za /2) = 1 — a/2, where 
© (z) is the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of т, by 0 and 1. 
Count the total number of zeros, and call this n 1: count the total number 
of ones, and call this n2. Group the data into maximal sub-seguences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 


211113 2 (ив—1)(ив—2 
(с) Compute HR = 81-01: + 1, апа OR = nitne-l 


R- 
(d) Compute the test statistic z = == 
oR 
(e) If |z| > 255, then reject the hypothesis. If |z| < za/2, then do not reject 
the hypothesis. 


2. Run test for randomness against an alternative that a trend is present in a sam- 
ple of binary values, large sample: 


(a) Determine the critical value z 4 such that Ф (za) = 1 — a, where Ф (z) 15 
the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of т, by 0 and 1. 
Count the total number of zeros, and call this n 1: count the total number 
of ones, and call this n2. Group the data into maximal sub-sequences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 


2ni1n» 2 _ (ив—1)(ив—2) 
(c) Compute ир = ar + 1, and op = ni+na—1 7 


R-— 
(d) Compute the test statistic z — сега 
OR 
(е) If z < —za, then reject the hypothesis (this suggests the presence of a 
trend in the data). If z > —za, then do not reject the hypothesis. 


3. Run test for randomness against an alternative that the data are periodic for a 
sample of binary values, large sample: 


(a) Determine the critical value z 4 such that Ф (za) = 1 — a, where Ф (z) 15 
the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of x; by 0 and 1. 
Count the total number of zeros, and call this n 1: count the total number 
of ones, and call this n5. Group the data into maximal sub-seguences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 


211113 28: мэ 
2122 +1, ando = в-Ошв-2) 1ДВн2), 


(c) Compute ид = cae SEI 


(d) Compute the test statistic z — 


OR : 
(e) If z > za, then reject the hypothesis (this suggests the data are periodic). 
If z < za, then do not reject the hypothesis. 
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4. Chi-sguare test that the data are drawn from a speci c k-parameter multino- 
mial distribution, large sample: 


(a) Determine the critical value x2 such that F (х2) = 1 — a, where F(z) 
is the chi-square distribution with k — 1 degrees of freedom. 

(b) The k-parameter multinomial has k possible outcomes А1, A», ..., Ар 
with probabilities pı, p2,..., pg. For i = 1,2,...,k, compute nj, the 
number of x ;’s corresponding to А;. 


(c) Еог? = 1,2,...,k, compute the sample multinomial parameters р, = 
2 NS (ni — np)“ 
(d) Compute the test statistic x^ = Ж ---. 
i21 ЭР 
(е) If x“ > x2, then reject the hypothesis. If x? < x2, then do not reject 
the hypothesis. 


5. Chi-square test for independence of attributes A and B having possible out- 
comes Ду, Аә,..., Ay and B1, Bo,...,Bm: 


(a) Determine the critical value x2 such that F (X2) = 1 — a, where ЕС) 
is the chi-square distribution with (k — 1)(m — 1) degrees of freedom. 

(b) For? = 1,2,...,k andj = 1,2,...,m, dene oj; to be the number of 
observations having attributes A; and B,, and de ne о;. = 2372 о and 

k 

O.j — wey 043. 

(с) The variables de ned above are often collected into a table, called a соп- 
tingency table: 


А\ : 


01 


1 Оқ 0 Okm Ok. 
(d) Богі = 1,2,...,k and j = 1,2,...,m, compute the sample mean num- 
ber of observations in the ij cell of the contingency table 
04.0.5 
Eij = : 
1] n 


k m 2 
(e) Compute the test statistic, X? = 5 5 (бш eg). 
Бэй €ij 
1-1 j—1 
(f) If X? > x2, then reject ће hypothesis (that is, conclude that the attributes 
X Xa J YP 


are not independent). If x? < y2, then do not reject the hypothesis. 


6. Kolmogorov-Smirnov test that Fo (x) is the distribution of the population from 
which the sample was drawn: 


(a) Determine the critical value D, such that Q(D4) = 1— a, where Q(D) 
is the distribution function for the Kolmogorov-Smirnov test statistic D. 
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(b) Compute the sample distribution function F(z). 
(c) Compute the test statistic, given the maximum deviation of the sample 


and target distribution functions D = max |Ё (x) — Fo(a)}. 


(d) If D > Da, then reject the hypothesis (that is, conclude that the data are 
not drawn from Fo(x)). If < Da, then do not reject the hypothesis. 


7.11.4 HYPOTHESIS TESTS: DISTRIBUTIONS OF TWO 


POPULATIONS 
The following hypothesis tests assume a random sample of size n, given by 
[21,22,..., En }, and a random sample of size m, given by {y1,y2,---,Ym}- 


1. Chi-square test that two k-parameter multinomial distributions are equal, large 
sample: 


(a) Determine the critical value x2 such that F (X2) = 1 — a, where F(-) 
is the chi-square distribution with k — 1 degrees of freedom. 

(b) The k-parameter multinomials have k possible outcomes А1, A», ..., 
Ак. For i = 1,2,..., k, compute n;, the number of 2, s corresponding 
to Aj, and compute m;, the number of y;'s corresponding to Aj. 


(c) For i = 1,2,...,k, compute the sample multinomial parameters p; = 
Ni mi 


n+m " 
(d) Compute the test statistic, 


"d 


k y k 
ES GANE ni) „у amy э. (7.11.1) 
1-1 1-1 тр; 


(е) If x? > x2, then reject the hypothesis. If x? < x2, then do not reject 
the hypothesis. 


2. Mann-Whitney-Wilcoxon test for equality of independent continuous distri- 
butions, large sample: 


(a) Determine the critical value z,/5 such that © (25 /2) = 1 — a/2, where 
© (z) is the normal distribution function. 

(b) For i = 1,2,...,n andj = 1,2,...,т, dene 5;; = lif r, < yj and 
Sij = 01f x, > Ун 


(с) Сошрше (7 = > Y S. 


4-1 j—1 
U cm | 
mn(m+n+1 
V 12 
(e) If |z| > za/2, then reject the hypothesis. If |z| € 24/2, then do not reject 
the hypothesis. 


(d) Compute the test statistic z = 
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3. Spearman rank correlation coef cient for independence of paired samples, 
large sample: 


(a) Determine the critical value А уо such that F (Б) = 1- 2/2, where 
F (R) is the distribution function for the Spearman rank correlation co- 


ef cient. 
(b) The samples are ordered, with the smallest т; assigned the rank rı and 
the largest assigned the rank rp; for = 1,2,...,n, 2; is assigned rank 


ri if it occupies the i" position in the ordered list. Similarly the y, 8 are 
assigned ranks s,. In case of a tie within a sample, the ranks are averaged. 
(c) Compute the test statistic 


R= 


(d) If |R| > Ras, then reject the hypothesis. If |R| < Rasa, then do not 
reject the hypothesis. 


7.11.5 SEQUENTIAL PROBABILITY RATIO TESTS 


Given two simple hypotheses and m observations, compute: 


1. Pom = Prob (observations | Но). 
2. Pim = Prob (observations | H1). 
3. Um = Prim! Pom: 


Then make one of the following decisions: 
D 
1. Ғе, > шэг then reject Но. 
a 


2. Fum < 


then reject Hj. 

l-a 

8 1—8 
a 


3. If —— < Um < then make another observation. 


1—a 


Hence, the number of samples taken is not x eda priori, but determined as sampling 
occurs. 


EXAMPLES 


1. Let 0 denote the fraction of defective items. Two simple hypotheses are Ho: 0 = бо = 
0.05 and Hi: 0 = 9, = 0.15. Choose a = 5% and 8 = 10% (i.e., reject lot with 
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9 = бо about 5% of the time; accept lot with 9 = 0; about 10% of the time). If, after 
m observations, there are d defective items, then 


m d d 0 a 1-06 5 
Pim = ML (1 — 8,) and о = (8) (=) (7.11.2) 


Bo ы 


ї-а 1 
0.105 апа IE — 18. The decision to perform another observation depends on whether 
or not 


ОГ Um = 34(0.805)"-4, using the above numbers. The critical values аге 


0.105 < 34(0.895)774 < 18. (7.11.3) 


Taking logarithms, a (m — d, d) control chart can be drawn with the following lines: 
а = 0.101(m — d) — 2.049 and 4 = 0.101(m — 4) + 2.63. On the gure below, a 
sample path leading to rejection of Но has been indicated: 


d 


(defectives) 


Reject Hı 


n — d (non-defectives) 


2. Let X be normally distributed with unknown mean и and known standard deviation ø. 
Consider the two simple hypotheses, Но: и = no and Hi : u = ju. If Y is the sum 
of the rst m observations of X, then a (Y, m) control chart is constructed with the 


two lines: : 
y = BFE m 2 log E Я 
Е б (7.11.4) 
у= BT. z log S. 
2 pa — Ho a 


7.12 LINEAR REGRESSION 


1. The general linear statistical model assumes that the observed data values 
{y1,Y2,---,Ym} are of the form 


Yi = Bo + Pita + Bote +++ ийш + €i, 


fori = 1,2,...,m. 
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2. For? = 1,2,...,m апа j = 1,2,...,n, the independent variables x;; аге 
known (nonrandom). 


3. 480, 81, 82,-++ , Bn } are unknown parameters. 


4. For each 1, €, is a zero-mean normal random variable with unknown vari- 


ance c?. 


7.12.1 LINEAR MODEL y; = B + 12 + € 


1. Point estimate of д1: 


2. Point estimate of Dg: T т 
Bo = y — б\т. 


3. Point estimate of the correlation coef c ient: 


4. Point estimate of error variance 02: o? = += m 
5. The standard error of the estimate is de ned as s, = V о?. 
6. Least-squares regression line: y = Во + Biz. 


7. Con de nce interval for бо: 


(a) Determine the critical value ťa /> such that F (ta э) = 1 — 2/2, where 
Е (.) is the cumulative distribution function for the t-distribution with 
т — 2 degrees of freedom. 

(b) Compute the point estimate Bo. 


(c) Compute k = ta/28e 
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(d) The 100(1 — а) percent con den ce interval for 80 is given by 
[Bo — k.o + k|. 


8. Con de nce interval for 61: 


(a) Determine the critical value £,, /ҙ such that F (£,/5) = 1 — a/2, where 
F (.) is the cumulative distribution function for the t-distribution with 
т — 2 degrees of freedom. 

(b) Compute the point estimate Bi. 

(c) Compute k = ta ә ас 


(d) The 100(1 — а) percent con den ce interval for 91 is given by 
[й — E.B +k]. 


9. Con de nce interval for o°: 
(a) Determine the critical values x? jo and X one уз such that Р (2 " = 


1—a/2 and F (38-26 = a/2, where F (-) is the cumulative distribu- 


tion function for the chi-square distribution function with m — 2 degrees 


of freedom. ра 
(b) Compute the point estimate 77. 
29902 — 9902 
(c) Compute k1 — tae er and ky = шо. 
Ха/2 X1—a/2 


(d) The 100(1 — a) percent con den ce interval for с? is given by [ki , k2]. 


10. Con de nce interval (predictive interval) for y, given то: 


(a) Determine the critical value їг such that F (t4/2) = 1 — a/2, where 
F (.) is the cumulative distribution function for the t-distribution with 
т — 2 degrees of freedom. 

(b) Compute the point estimates Bo, ГА , and se. 


(c) Compute k = ta/28e and j — Bo + Bi zo. 


i=l 
(d) The 100(1 — а) percent con den ce interval for 91 is given by 


11. Test of the hypothesis 8; = 0 against the alternative 91 Z 0: 


(a) Determine the critical value £,, /> such that F (£,/5) = 1 — a/2, where 
F (-) is the cumulative distribution function for the t-distribution with 
т — 2 degrees of freedom. 
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(b) Compute the point estimates fi and se. 


ES 


(c) Compute the test statistic t = Pr 
se \ 4 
1-1 
(d) If |t| > у, then reject the hypothesis. If |t| < ta /2, then do not reject 


the hypothesis. 


7.12.2 GENERAL MODEL y = Во + 6121 + Bote +--+: + Bntn + € 


1. The m equations (i = 1,2,...,m) 
Vi = Bo + bizi + Baxia ++ байн + €i (7.12.1) 


can be written in matrix notation as у = X6 + e where 


yı Bo а 
92 £i €2 
у= |.|, = ЕЗГЕ = |; (7.12.2) 
Ут Bn Em 
and 
1 zu 212 Тіп 
1 21 229 00 Don 
X a 221 21 (7.12.3) 
1 tml 2 тә t Emn 


2. Throughout the remainder of ће section, we assume X has full column rank. 


3. The least-sguares estimate @ satis es the normal eguations XX3 = X'y. 
That is, Ž = (ХТХ) ХҮ. 


4. Point estimate of 07: 


25 1 AT 
о? = ——— СЕ В (X'y)) : 
т-тп-і1 
5. The standard error of the estimate is de ned as s. = тэ 


6. Least-squares regression line: $j = хі). 


7. In the following, let c;; denote the (i, j) entry in the matrix (XTX) ee 


8. Con de nce interval for 8;: 


(a) Determine the critical value t, /; such that F (t4/2) = 1 — a/2, where 
F (.) is the cumulative distribution function for the t-distribution with 
т — n — 1 degrees of freedom. 
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(b) Compute the point estimate 8, by solving the normal eguations, and 
compute se. 

(c) Compute kj = ta/28e Cii- 

(d) The 100(1 — a) percent con den ce interval for 8; is given by 


E — ki, Bi + ki]. 


9. Con de nce interval for o°: 


(a) Determine the critical values x /2 апа XT. а/? such that F (х2 2 = 


1 — a/2 and F e) = @/2, where F (-) is the cumulative distri- 
bution function for the chi-square distribution function with m — n — 1 
degrees of freedom. 

(b) Compute the point estimate 03. 


ШИНЭ ое. Е. 
(c) Compute k1 = UA and ko = шеш. 
Хауә X1-a/2 


(d) The 100(1 — a) percent con den ce interval for о? is given by [ki , kə]. 


10. Con de nce interval (predictive interval) for y, given хо: 


(a) Determine the critical value £,, /ҙ such that F (£,/5) = 1 — a/2, where 
F (-) is the cumulative distribution function for the t-distribution with 
n — m — 1 degrees of freedom. 

(b) Compute the point estimate 8, by solving the normal eguations, and 
compute se. 

(c) Compute k = ta/2 Se V1 + x (XTX) Xo andy = хїЙ. 

(d) The 100(1—a) percent con dence interval for 51 is given by [y — k, 9 + k]. 


11. Test of the hypothesis 2; = 0 against the alternative 8; Z 0: 


(a) Determine the critical value ťa уә such that F (ta J2) = 1 — a/2, where 
F (-) is the cumulative distribution function for the t-distribution with 
m — n — 1 degrees of freedom. 

(b) Compute the point estimates 8, апа ве by solving the normal eguations. 

Bi 

8 ev/ Ci 1 

(d) If |t| > уә, then reject the hypothesis. If |t| < ta /2, then do not reject 
the hypothesis. 


(c) Compute the test statistic t = 


7.13 ANALYSIS OF VARIANCE (ANOVA) 


Analysis of variance (ANOVA) is a statistical methodology for determining informa- 
tion about means. The analysis uses variances both between and within samples. 
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7.13.1 ONE-FACTOR ANOVA 
1. Suppose we һауе k samples from k populations, with the j population con- 


sisting of nj observations, 


Ui1: у21,...,Уп1\1 
1412, Y225 ---, Uns2 


Yik» Y2ko +++ > Vnyk: 


2. One-factor model: 


(a) The one-factor ANOVA assumes that the i observation from the j” 


sample is of the form y;; = U + Tj + eij- 

(b) For j = 1,2,...,k, the parameter и; = u + Tj is the unknown mean of 
the j" population, and De Tj — 0. 

(c) Fori = 1,2,...,k and j = 1,2,...,n;, the random variables ej; are 
independent and normally distributed with mean zero and variance о 2. 

(d) The total number of observations is n = n4 + no + ··· + т. 


3. Point estimates of means: 
jd 
(a) Total sample mean ĵ = 5 У Vij- 


j=l i=1 


n 
1 2 
(b) Sample mean of j sample 2) = — > Vij- 
nj 1 


4. Sums of squares: 


k 
(a) Sum of squares between samples SS, = 5 ni (9; = 8). 
ae 
(b) Sum of squares within samples SS, = 5 b (yij — Gj) 
j=l i=l 
k nj 
(c) Total sum of squares Total SS = » Ж (Wij — ў). 
j=l i=1 


(d) Partition of total sum of squares Total SS = SS, + 55у. 


5. Degrees of freedom: 


(a) Between samples, k — 1. 
(b) Within samples, n — k. 
(c) Total, n — 1. 
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6. Mean sguares: 


(a) Obtained by dividing sums of sguares by their respective degrees of 
freedom. 


SS 
(b) Between samples, MS, = г i D 
55, 
(c) Within samples (also called the residual mean square), MS w = T 
п — 
7. Test of the hypothesis ші = рә = = ик against the alternative и; A М; for 
some i and 7; equivalently, test the null hypothesis т = 75 Ty = 0 


against the hypothesis Tj Z 0 for some j: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F-distribution with k — 1 
and n — k degrees of freedom. 

(b) Compute the point estimates 7 and J; for j = 1,2,...,k. 

(c) Compute the sums of squares SS, and 55,,. 

(d) Compute the mean squares MS, and М5,,. 


MS 
(e) Compute the test statistic F = Ms. ; 
(f) If F > Fa, then reject the hypothesis. If F < Fa, then do not reject the 


hypothesis. 
(g) The above computations are often саа into ап ANOVA table: 


DOF MS 


Between samples MS, | Е = М5, 
Within samples n— | MSy 
CERE 


8. Con de nce interval for jjj — pj, for i £ j: 


(a) Determine the critical value ta /ҙ such that F (ta /2) = 1— а/2, where 
F (-) is the cumulative distribution function for the t-distribution with 
n — k degrees of freedom. 

(b) Compute the point estimates J; and Jj. 

(c) Compute the residual mean square MS w. 

(d) Compute k = ta24/ М5, (z + 2) 

Ni Nj 

(е) The 100(1 — a) percent con de nce interval for и; — и; is given by 

[(9; — yj) — k, (yi — uj) + k). 


9. Con de nce interval for contrast in the means, de ned by C = суш + cop» + 
c egg, Where ci + Co +-+ + ck = 0: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F-distribution with k — 1 
and n — k degrees of freedom. 
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(b) Compute the point estimates J; for j = 1,2,...,k. 
(c) Compute the residual mean square MS w. 


(d) Compute k = 


(е) The 100(1 — a) percent con den ce interval for the contrast C is given 
k k 
by [Ус — k o; + k]. 
j=l j=l 


7.13.2 UNREPLICATED TWO-FACTOR ANOVA 


1. Suppose we have a sample of observations y;; indexed by two factors % = 
1,2,...,m and j =1,2,...,n. 


2. Unreplicated two-factor model: 


(a) The unreplicated two-factor ANOVA assumes that the ij observation is 
of the form Vij =p + 8: + Tj + бїр 

(b) и is the overall mean, 5; is the i differential effect of factor one, Tj 18 
the 7 differential effect of factor two, and 


m n 
Уй; — Ут) = 0. 
i—1 j=l 


(c) For i = 1,2,...,m and j = 1,2,...,n, the random variables е;; are 
independent and normally distributed with mean zero and variance т? 
(d) Total number of observations is mn. 


3. Point estimates of means: 


M 1 m n 
(a) Total sample mean y = m 5 5 Vij- 


121 1-1 


21€ 
(b) 28 factor-one sample mean y;. = т 5 Vij- 
j=l 


do ЖА 
(с) j“ factor-two sample mean 2. j 2 — 5 Vij- 
m 
i=1 
4. Sums of squares: 
m 
(a) Factor-one sum of sguares SS1 — n 5 (9. — 9)“. 
4-і 


т 
(b) Factor-two sum of squares 555 = m Уу (9;- ў). 


j=l 
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m n 


(c) Residual sum of sguares SS, — > у (у — Yi. — 9.3 + 9). 
i=1 j=l 
n m 


(d) Total sum of sguares Total SS — 5 5 (yij — 8). 
j=l i=1 
(e) Partition of total sum of squares Total SS = SS; + 552 + SS,. 


5. Degrees of freedom: 


(a) Factor one, m — 1. 

(b) Factor two, n — 1. 

(c) Residual, (m — 1)(n — 1). 
(d) Total, mn — 1. 


6. Mean squares: 


(a) Obtained by dividing sums of squares by their respective degrees of 


freedom. ss 
(b) Factor-one mean square MS; = : T 
m — 
55, 
(c) Factor-two mean square MS» = 1 
n 
SS, 
(d) Residual mean sguare MS, — m= Dial 
7. Test of the null hypothesis 21 = 85 = --- = Bm = 0 (no factor-one effects) 


against the alternative hypothesis 9, Z 0 for some 4: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F-distribution with m — 1 
and (m — 1)(n — 1) degrees of freedom. 

(b) Compute the point estimates / and ¥;. fori = 1,2,...,m. 

(c) Compute the sums of squares 551 and SS,. 

(d) Compute the mean squares MS, and MS,. 


MS 
(e) Compute the test statistic F = Ы. 


(f) If F > Fa, then reject the hypothesis. If F < Fa, then do not reject the 
hypothesis. 


8. Test of the null hypothesis ті Тә ETA 0 (no factor-two effects) 
against the alternative hypothesis 7; Z 0 for some j: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F-distribution with n — 1 
and (m — 1)(n — 1) degrees of freedom. 

(b) Compute the point estimates 2 and j.; for j =1,2,...,n. 

(с) Compute the sums of squares SS» and 55,. 
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(d) Compute the mean squares MS» and MS,. 
М5, 


(е) Compute the test statistic F = 


5, 
(f) If F > Fy, then reject the hypothesis. If F < Fa, then do not reject the 
hypothesis. 
(g) The above computations are often organized into an ANOVA table: 


[Some | 55 [ рок мз [Ек] 


Factor one 


Factor two 
Residual 


[ud — [mass] —-1 1 1 — 


9. Con de nce interval for contrast in the factor-one means, de ned by C — 
С101 + co Bo b + Cm, where ci + co +--+ Cm = 0: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F-distribution with m — 1 
and (m — 1)(n — 1) degrees of freedom. 

(b) Compute the point estimates ¥;. for? = 1,2,...,m. 

(c) Compute the residual mean square MS,. 


(d) Compute k = 


(е) The 100(1 — a) percent con den ce interval for the contrast C is given 


by 
m m 
> сй. i k, 5 Cilji. + k 
4-1 121 


10. Con de nce interval for contrast in the factor-two means, de ned by С = 
сүтү + сәтә b + CnTn, Where ci + со +++: + Cn = 0: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
1s the cumulative distribution function for the F-distribution with n — 1 
and (m — 1)(n — 1) degrees of freedom. 

(b) Compute the point estimates 7, for j = 1,2,...,п 

(c) Compute the residual mean sguare MS,. 


1 n 
2 
2,9 
j=l 
(е) The 100(1 — a) percent con den ce interval for the contrast C is given 
by 


(d) Compute k = 


n n 
Ус ==, k, 5 су. + k 
7-1 j=l 
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7.13.3 REPLICATED TWO-FACTOR ANOVA 


1. Suppose we have a sample of observations y;j; indexed by two factors 1 = 
1,2,...,m and j = 1,2,...,n. Moreover, there are p observations per factor 
pair (i, j), indexed by k = 1,2,...,p. 


2. Replicated two-factor model: 


(a) The replicated two-factor ANOVA assumes that the ijk" observation is 
of the form уук = H + Bi + ту + Viz + eijk- 

(b) и is the overall mean, 5; is the 1" differential effect of factor one, Tj 18 
the 7 differential effect of factor two, and 


m n 
r, 
i=1 j=1 
(c) Fori = 1,2,...,m and j = 1,2,...,n, yj is the ij" interaction effect 


of factors one and two. 

(d) Fori = 1,2,...,m, j = 1,2,...,n, and k = 1,2,...,p, the random 
variables еҙ); are independent and normally distributed with mean zero 
and variance 07. 


(е) Total number of observations is mnp. 


3. Point estimates of means: 


m n р 


1 
a) Total sample теап = —— iik. 
(a) p y mnp > 5 > Vijk 


i=1 j—1 k—1 
PE 
(b) i factor-one sample mean @;. = — 5 5 Vijk- 
np = 
7-1 k=1 
тор 
с) 28 factor-two sample mean 9, = — ik. 
(с) 7 p y.j mp2, 2.5 


A p 
(d) 1)" interaction mean jy;;. = — 5 Vijk- 
k=1 


4. Sums of squares: 


m 
(a) Factor-one sum of sguares SS1 — пу” (8. — 9)“. 
i=1 


n 
(b) Factor-two sum of squares 552 = тру” (9.5. — 9)’. 
j=l 


m n 
(c) Interaction sum of squares SS 12 = p A > (gi. = 8). 
іі ізі 
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i=l j 
(0) Partition of total sum of squares Tota 


— s 
Ф || 
т- 
I 
n 
о 
= 
+ 
Nn 
n 
N 
+ 
о 
о 
на 
ь 
+ 
о 
о 
E 


5. Degrees of freedom: 


(a) Factor one, m — 1. 

(b) Factor two, n — 1. 

(c) Interaction, (m — 1)(n — 1). 
(d) Residual, mn(p — 1). 

(e) Total, mnp — 1. 


6. Mean squares: 


(a) Obtained by dividing sums of squares by their respective degrees of 


freedom. 54 
(b) Factor-one mean sguare MS1 = 
m — 
55, 
(c) Factor-two mean square MS» = D 
SS 
(d) Interaction mean square М5 2 = ат: 
SS, 
(е) Residual mean square MS, = ———. 
mn(p — 1) 
7. Test of the null hypothesis 21 = 5 = --- = Bm = 0 (no factor-one effects) 


against the alternative hypothesis 9, Z 0 for some 4: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F-distribution with m — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates ¥ and ¥;.. for i = 1,2,...,m. 

(c) Compute the sums of squares 551 and SS,. 

(d) Compute the mean squares MS, and MS,. 


MS 
(e) Compute the test statistic F = 


(f) ГЕ > Fa, then reject the hypothesis. If F < Fa, then do not reject the 
hypothesis. 


8. Test of the null hypothesis ті T2 5 = TR 0 (no factor-two effects) 
against the alternative hypothesis т; Z 0 for some 7: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F-distribution with n — 1 
and mn(p — 1) degrees of freedom. 
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(b) Compute the point estimates 7 and J.j. for j = 1,2,...,n 
(c) Compute the sums of squares 552 and SS,. 

(d) Compute the mean squares MS» and MS,. 

2 


(e) Compute the test statistic F = 


Se 
(f) ГЕ > Fa, then reject the hypothesis. If F < Fa, then do not reject the 
hypothesis. 


9. Test of the null hypothesis y;; = 0 for? = 1,2,..., m and j = 1,2,...,n (no 
factor-one effects) against the alternative hypothesis y;; Z 0 for some i and j: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F’-distribution with (m — 
1)(n — 1) and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates J, j;.., 1), and Jiz. fori = 1,2,...,m and 
j 52; m 

(c) Compute the sums of squares 5512 and SS,. 

(d) Compute the mean squares MS12 and MS,. 


(e) Compute the test statistic F = 


Sr 
(f) If F > Fy, then reject the hypothesis. If F < Fa, then do not reject the 
hypothesis. 
(g) The above computations are often organized into an ANOVA table: 


Factor one m F = MS, /MS, 
Factor two F = MS,/MS, 


Interaction m — F = М5,5/М85, 
Residual 


r p r 
[tal [mess] m1 1 1 — —] 


10. Con de nce interval for contrast in the factor-one means, de ned by C — 
C181 + c9 Bo + +++ + съ m, where ci + сә +++ + Cm = 0: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
is the cumulative distribution function for the F-distribution with m — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates У;.. fori = 1,2,...,m. 

(c) Compute the residual mean square MS,. 


(d) Compute k = 


(е) The 100(1 — a) percent con den ce interval for the contrast C is given 
by 


m m 
[x с == k, Эс Cii. + k 
i=1 121 
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11. Con de nce interval for contrast in the factor-two means, de nd by С = 
CITI + сәтә +++ + CnTn, Where ci + со + +++ + Ch = 0: 


(a) Determine the critical value F4 such that F (Fa) = 1 — a, where F (-) 
1s the cumulative distribution function for the F-distribution with n — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates 7. ;. for j = 1,2,...,n. 

(c) Compute the residual mean sguare MS,. 


(d) Compute k = 


(е) The 100(1 — a) percent con den ce interval for the contrast C is given 
by 


n n 
5 сұр ын k, 5 ПЕН +k 
j=l j=l 


FIGURE 7.5 
The shaded region is de ned by X > za and has area a (here X is N(0,1)). 


7.14 PROBABILITY TABLES 


7.14.1 CRITICAL VALUES 


1. The critical value za satises $(z4) = 1 — a (where, as usual, Ф(2) is the 
distribution function for the standard normal). See Figure 7.5. 


nee = rn её ф = 5 (1 + erf (5) (7.14.1) 


2. The critical value tą satises F(t.) = 1— a where F(-) is the distribution 
function for the ¢-distribution (for a speci ed number of degrees of freedom). 
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FIGURE 7.6 


Illustration of o and 2g regions of a normal distribution. 


p-o p HFT 


3. The critical value x2 satis es F(x2) = 1 — a where F(-) is the distribution 
function for the x“ -distribution (for a speci ed number of degrees of freedom). 
4. The critical value Р satis es F(F4) = 1 — a where F(-) is the distribution 
function for the F-distribution (for a speci ed number of degrees of freedom). 


7.14.2 TABLE OF THE NORMAL DISTRIBUTION 


For a standard normal random variable (see Figure 7.6): 


Е Proportion of ini 
mits p Remaining 
the m arca 75 


1282 1.645 1.960 2.326 2.576 3.090 
G(x) |090 0.95 0.975 099 0.995 0.999 
2[1— Ф(2)] |020 010 005 002 001 0.002 
309 372 426 475 520 561 6.00 636 


1-Ф(г) |1073 10-4 10-5 10-6 


For large values of т: 


ES G = 2) <1-(2) < се () (7.142) 
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= Fo [== (2 [= (1-5001/09 | 
0.50399 | 0.49601 | 0.39892 0.50798 | 0.49202 3 
0.51197 | 0.48803 | 0.39876 0.51595 | 0.48405 
0.51994 | 0.48006 | 0.39844 ; 0.52392 | 0.47608 
0.52790 | 0.47210 | 0.39797 А 0.53188 | 0.46812 
0.53586 | 0.46414 | 0.39733 А 0.53983 | 0.46017 
0.54380 | 0.45621 | 0.39654 0.54776 | 0.45224 
0.55172 | 0.44828 | 0.39559 0.55567 | 0.44433 
0.55962 | 0.44038 | 0.39448 0.56356 | 0.43644 
0.56749 | 0.43250 | 0.39322 0.57142 | 0.42858 
0.57534 | 0.42466 | 0.39181 0.57926 | 0.42074 


0.58317 | 0.41683 | 0.39024 0.58706 | 0.41294 
0.59095 | 0.40905 | 0.38853 0.59484 | 0.40516 
0.59871 | 0.40129 | 0.38667 0.60257 | 0.39743 
0.60642 | 0.39358 | 0.38466 || 0. 0.61026 | 0.38974 
0.61409 | 0.38591 | 0.38251 А 0.61791 | 0.38209 
0.62172 | 0.37828 [0.38023 : 0.62552 | 0.37448 
0.62930 | 0.37070 | 0.37780 || 0. 0.63307 | 0.36693 
0.63683 | 0.36317 | 0.37524 || 0. 0.64058 | 0.35942 
0.64431 | 0.35569 | 0.37255 А 0.64803 | 0.35197 
0.65173 | 0.34827 [0.36973 0.65542 | 0.34458 


0.65910 | 0.34090 | 0.36678 0.66276 | 0.33724 
0.66640 | 0.33360 | 0.36371 0.67003 | 0.32997 
0.67365 | 0.32636 | 0.36053 0.67724 | 0.32276 
0.68082 | 0.31918 | 0.35723 0.68439 | 0.31561 
0.68793 | 0.31207 | 0.35381 0.69146 | 0.30854 
0.69497 | 0.30503 | 0.35029 0.69847 | 0.30153 
0.70194 | 0.29806 | 0.34667 0.70540 | 0.29460 
0.70884 | 0.29116 | 0.34294 0.71226 | 0.28774 
0.71566 | 0.28434 | 0.33912 || 0. 0.71904 | 0.28096 
0.72240 | 0.27759 | 0.33521 Я 0.72575 | 0.27425 


0.72907 | 0.27093 [0.33121 0.73237 | 0.26763 
0.73565 | 0.26435 [0.32713 ; 0.73891 | 0.26109 
0.74215 | 0.25785 | 0.32297 ; 0.74537 | 0.25463 
0.74857 | 0.25143 | 0.31874 : 0.75175 | 0.24825 
0.75490 | 0.24510 | 0.31443 Д 0.75804 | 0.24196 
0.76115 | 0.23885 | 0.31006 0.76424 | 0.23576 
0.76731 | 0.23270 | 0.30563 0.77035 | 0.22965 
0.77337 | 0.22663 | 0.30114 0.77637 | 0.22363 
0.77935 | 0.22065 | 0.29659 0.78231 | 0.21769 
0.78524 | 0.21476 | 0.29200 0.78814 | 0.21185 
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E Fo (1-Е00179 [= [= Oone | 
0.79103 | 0.20897 10.28737 0.79389 | 0.20611 1 
0.79673 | 0.20327 10.28269 0.79955 | 0.20045 
0.80234 | 0.19766 10.27798 : 0.80510 | 0.19490 
0.80785 | 0.19215 10.27324 : 0.81057 | 0.18943 
0.81327 | 0.18673 10.26848 А 0.81594 | 0.18406 
0.81859 | 0.18141 | 0.26369 0.82121 | 0.17879 
0.82381 | 0.17619 | 0.25888 0.82639 | 0.17361 
0.82894 | 0.17106 | 0.25406 0.83147 | 0.16853 
0.83398 | 0.16602 | 0.24923 0.83646 | 0.16354 
0.83891 | 0.16109 | 0.24439 0.84135 | 0.15865 


0.84375 | 0.15625 | 0.23955 0.84614 | 0.15386 
0.84849 | 0.15151 |0.23471 0.85083 | 0.14917 
0.85314 | 0.14686 | 0.22988 0.85543 | 0.14457 
0.85769 | 0.14231 | 0.22506 || 1. 0.85993 | 0.14007 
0.86214 | 0.13786 | 0.22025 0.86433 | 0.13567 
0.86650 | 0.13350 | 0.21546 0.86864 | 0.13136 
0.87076 | 0.12924 | 0.21069 0.87286 | 0.12714 
0.87493 | 0.12507 | 0.20594 0.87698 | 0.12302 
0.87900 | 0.12100 | 0.20121 0.88100 | 0.11900 
0.88298 | 0.11702 | 0.19652 0.88493 | 0.11507 


0.88686 | 0.11314 | 0.19186 0.88877 | 0.11123 
0.89065 | 0.10935 | 0.18724 0.89251 | 0.10749 
0.89435 | 0.10565 | 0.18265 0.89616 | 0.10383 
0.89796 | 0.10204 | 0.17810 0.89973 | 0.10027 
0.90148 | 0.09853 | 0.17360 0.90320 | 0.09680 
0.90490 | 0.09510 | 0.16915 0.90658 | 0.09342 
0.90824 | 0.09176 | 0.16474 0.90988 | 0.09012 
0.91149 | 0.08851 | 0.16038 0.91309 | 0.08692 
0.91466 | 0.08534 | 0.15608 : 0.91621 | 0.08379 
0.91774 | 0.08226 | 0.15183 0.91924 | 0.08076 


0.92073 | 0.07927 | 0.14764 0.92220 | 0.07780 
0.92364 | 0.07636 | 0.14350 0.92507 | 0.07493 
0.92647 | 0.07353 | 0.13943 0.92785 | 0.07215 
0.92922 | 0.07078 | 0.13542 0.93056 | 0.06944 
0.93189 | 0.06811 | 0.13147 0.93319 | 0.06681 
0.93448 | 0.06552 | 0.12758 0.93575 | 0.06426 
0.93699 | 0.06301 | 0.12376 0.93822 | 0.06178 
0.93943 | 0.06057 | 0.12001 0.94062 | 0.05938 
0.94179 | 0.05821 | 0.11632 0.94295 | 0.05705 
0.94408 | 0.05592 | 0.11270 0.94520 | 0.05480 
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= TF [= fe) [= [= Fone | 
0.94630 | 0.05370 | 0.10916 0.94738 | 0.05262 А 
0.94845 | 0.05155 | 0.10568 0.94950 | 0.05050 
0.95053 | 0.04947 | 0.10226 0.95154 | 0.04846 
0.95254 | 0.04746 | 0.09892 : 0.95352 | 0.04648 
0.95449 | 0.04551 10.09566 . 0.95544 | 0.04457 
0.95637 | 0.04363 | 0.09246 0.95728 | 0.04272 
0.95818 | 0.04181 | 0.08933 0.95907 | 0.04093 
0.95994 | 0.04006 | 0.08628 0.96080 | 0.03920 
0.96164 | 0.03836 | 0.08329 0.96246 | 0.03754 
0.96327 | 0.03673 | 0.08038 0.96407 | 0.03593 


0.96485 | 0.03515 | 0.07754 0.96562 | 0.03438 
0.96637 | 0.03363 | 0.07477 0.96712 | 0.03288 
0.96784 | 0.03216 | 0.07207 0.96856 | 0.03144 
0.96926 | 0.03074 | 0.06943 Р 0.96995 | 0.03005 
0.97062 | 0.02938 | 0.06687 : 0.97128 | 0.02872 
0.97193 | 0.02807 | 0.06438 : 0.97257 | 0.02743 
0.97320 | 0.02680 10.06195 0.97381 | 0.02619 
0.97441 | 0.02559 | 0.05960 0.97500 | 0.02500 
0.97558 | 0.02442 | 0.05730 || 1. 0.97615 | 0.02385 
0.97671 | 0.02329 | 0.05508 0.97725 | 0.02275 


0.97778 | 0.02222 | 0.05292 0.97831 | 0.02169 
0.97882 | 0.02118 | 0.05082 0.97933 | 0.02067 
0.97982 | 0.02018 | 0.04879 0.98030 | 0.01970 
0.98077 | 0.01923 | 0.04682 0.98124 | 0.01876 
0.98169 | 0.01831 | 0.04491 0.98214 | 0.01786 
0.98257 | 0.01743 | 0.04307 0.98300 | 0.01700 
0.98341 | 0.01659 | 0.04128 0.98382 | 0.01618 
0.98422 | 0.01578 | 0.03955 0.98461 | 0.01539 
0.98500 | 0.01500 | 0.03788 . 0.98537 | 0.01463 
0.98574 | 0.01426 | 0.03626 0.98610 | 0.01390 


0.98645 | 0.01355 | 0.03470 0.98679 | 0.01321 
0.98713 | 0.01287 | 0.03319 0.98745 | 0.01255 
0.98778 | 0.01222 | 0.03174 0.98809 | 0.01191 
0.98840 | 0.01160 | 0.03034 0.98870 | 0.01130 
0.98899 | 0.01101 | 0.02899 0.98928 | 0.01072 
0.98956 | 0.01044 | 0.02768 0.98983 | 0.01017 
0.99010 | 0.00990 | 0.02643 0.99036 | 0.00964 
0.99061 | 0.00939 | 0.02522 0.99086 | 0.00914 
0.99111 | 0.00889 | 0.02406 0.99134 | 0.00866 
0.99158 | 0.00842 | 0.02294 0.99180 | 0.00820 
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E Fo 0o [= [= Oone 
0.99202 | 0.00798 | 0.02186 0.99224 | 0.00776 А 
0.99245 | 0.00755 | 0.02083 0.99266 | 0.00734 
0.99286 | 0.00714 | 0.01984 0.99305 | 0.00695 
0.99324 | 0.00676 | 0.01888 0.99343 | 0.00657 
0.99361 | 0.00639 | 0.01797 0.99379 | 0.00621 
0.99396 | 0.00604 | 0.01709 0.99413 | 0.00587 
0.99430 | 0.00570 | 0.01625 0.99446 | 0.00554 
0.99461 | 0.00539 | 0.01545 0.99477 | 0.00523 
0.99491 | 0.00509 | 0.01468 0.99506 | 0.00494 
0.99520 | 0.00480 | 0.01394 0.99534 | 0.00466 


0.99547 | 0.00453 | 0.01323 0.99560 | 0.00440 
0.99573 | 0.00427 | 0.01256 0.99586 | 0.00415 
0.99598 | 0.00402 | 0.01191 0.99609 | 0.00391 
0.99621 | 0.00379 | 0.01129 ||2. 0.99632 | 0.00368 
0.99643 | 0.00357 | 0.01071 0.99653 | 0.00347 
0.99664 | 0.00336 | 0.01014 0.99674 | 0.00326 
0.99683 | 0.00317 | 0.00961 0.99693 | 0.00307 
0.99702 | 0.00298 | 0.00909 0.99711 | 0.00289 
0.99720 | 0.00280 | 0.00860 0.99728 | 0.00272 
0.99736 | 0.00264 | 0.00814 0.99745 | 0.00255 


0.99752 | 0.00248 | 0.00770 0.99760 | 0.00240 
0.99767 | 0.00233 | 0.00727 0.99774 | 0.00226 
0.99781 | 0.00219 | 0.00687 0.99788 | 0.00212 
0.99795 | 0.00205 | 0.00649 0.99801 | 0.00199 
0.99807 | 0.00193 | 0.00613 0.99813 | 0.00187 
0.99819 | 0.00181 | 0.00578 0.99825 | 0.00175 
0.99830 | 0.00169 | 0.00545 0.99836 | 0.00164 
0.99841 | 0.00159 | 0.00514 0.99846 | 0.00154 
0.99851 | 0.00149 | 0.00485 : 0.99856 | 0.00144 
0.99860 | 0.00139 10.00457 : 0.99865 | 0.00135 


0.99869 | 0.00131 | 0.00430 0.99874 | 0.00126 
0.99878 | 0.00122 | 0.00405 : 0.99882 | 0.00118 
0.99886 | 0.00114 10.00381 : 0.99889 | 0.00111 
0.99893 | 0.00107 | 0.00358 : 0.99896 | 0.00103 
0.99900 | 0.00100 | 0.00337 Я 0.99903 | 0.00097 
0.99906 | 0.00093 | 0.00317 0.99910 | 0.00090 
0.99913 | 0.00087 | 0.00298 0.99916 | 0.00085 
0.99918 | 0.00082 | 0.00279 0.99921 | 0.00079 
0.99924 | 0.00076 | 0.00262 0.99926 | 0.00074 
0.99929 | 0.00071 | 0.00246 0.99931 | 0.00069 
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= Fo 11500179) (2 Fo Fono | 

0.99934 | 0.00066 | 0.00231 0.99936 | 0.00064 |0.00224 
0.99938 | 0.00062 | 0.00216 0.99940 | 0.00060 |0.00210 
0.99942 | 0.00058 | 0.00203 0.99944 | 0.00056 |0.00196 
0.99946 | 0.00054 | 0.00190 , 0.99948 | 0.00052 |0.00184 
0.99950 | 0.00050 | 0.00178 3 0.99952 | 0.00048 |0.00172 
0.99953 | 0.00047 | 0.00167 0.99955 | 0.00045 0.00161 
0.99957 | 0.00043 | 0.00156 0.99958 | 0.00042 0.00151 
0.99960 | 0.00040 | 0.00146 0.99961 | 0.00039 {0.00141 
0.99962 | 0.00038 | 0.00136 0.99964 | 0.00036 0.00132 
0.99965 | 0.00035 | 0.00128 0.99966 | 0.00034 


0.99967 | 0.00032 | 0.00119 0.99969 | 0.00031 
0.99970 | 0.00030 | 0.00111 0.99971 | 0.00029 
0.99972 | 0.00028 | 0.00104 0.99973 | 0.00027 
0.99974 | 0.00026 | 0.00097 ; 0.99975 | 0.00025 
0.99976 | 0.00024 | 0.00090 | 3. 0.99977 | 0.00023 
0.99978 | 0.00022 | 0.00084 | 3. 0.99979 | 0.00021 
0.99979 | 0.00021 | 0.00078 : 0.99980 | 0.00020 
0.99981 | 0.00019 10.00073 | 0.99982 | 0.00018 
0.99982 | 0.00018 | 0.00068 : 0.99983 | 0.00017 
0.99984 | 0.00016 | 0.00063 0.99984 | 0.00016 


0.99985 | 0.00015 | 0.00059 0.99985 | 0.00015 
0.99986 | 0.00014 | 0.00055 5 0.99986 | 0.00014 
0.99987 | 0.00013 10.00051 0.99987 | 0.00013 
0.99988 | 0.00012 | 0.00047 0.99988 | 0.00012 
0.99989 | 0.00011 | 0.00044 0.99989 | 0.00011 
0.99990 | 0.00010 | 0.00041 0.99990 | 0.00010 
0.99990 | 0.00010 | 0.00038 0.99991 | 0.00009 
0.99991 | 0.00009 | 0.00035 0.99991 | 0.00009 
0.99992 | 0.00008 | 0.00033 ; 0.99992 | 0.00008 
0.99992 | 0.00007 | 0.00030 || 3. 0.99993 | 0.00007 


0.99993 | 0.00007 | 0.00028 0.99993 | 0.00007 
0.99994 | 0.00006 | 0.00026 || 3. 0.99994 | 0.00006 
0.99994 | 0.00006 | 0.00024 || 3. 0.99994 | 0.00006 
0.99995 | 0.00005 | 0.00022 || 3. 0.99995 | 0.00005 
0.99995 | 0.00005 | 0.00021 5 0.99995 | 0.00005 
0.99995 | 0.00005 10.00019 || 3. 0.99996 | 0.00004 
0.99996 | 0.00004 | 0.00018 : 0.99996 | 0.00004 
0.99996 | 0.00004 | 0.00016 0.99996 | 0.00004 
0.99996 | 0.00004 | 0.00015 0.99997 | 0.00003 
0.99997 | 0.00003 | 0.00014 0.99997 | 0.00003 
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7.14.3 PERCENTAGE POINTS, STUDENT S ¢-DISTRIBUTION 
For a given value of n and a this table gives the value of t œn such that 
ДШ (изү... гүүг” _ 
Han) = ис “\ИттГ(п/2). (1 + =) dx = 1-а. (7.14.3) 
The t-distribution is symmetrical, so that F(—t) = 1 — F(t). 


EXAMPLE Тһе table gives ty —o.60,n—2 = 0.325. 
Hence, when n — 2, F(0.325) — 0.4. 


F(t) 


O I а 
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© 00-10 tA 


N 
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EO I ee ee ee 


0. 0000393 
0.0100 
0.0717 

0.207 
0.412 
0.676 
0.989 
1.34 
1.73 
2.16 
2.60 
3.07 
3.51. 
4.07 
4.60 
5.14 
5.70 
6.26 
6.84 
7.43 
8.03 
8.64 
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0. 0001571 
0.0201 
0.115 
0.297 
0.554 
0.872 
1.24 
1.65 
2.09 
2.56 
3.05 
3.57 
4.11 
4.66 
5.23 
5.81 
6.41 
7.01 
7.63 
8.26 
8.90 
9.54 
10.2 
10.9 
11.5 
15.0 
18.5 
29.7 


0. 0009821 
0.0506 
0.216 
0.484 
0.831 
1.24 
1.69 
2.18 
2.70 
3.25 
3.82 
4.40 
5.01 
5.63 
6.26 
6.91 
7.56 
8.23 
8.91 
9.59 
10.3 
11.0 


0. 00393 
0.103 
0.352 
0.711 

1.15 
1.64 
2.17 
219 
3.33 
3.94 
4.57 
5.23 
5.89 
6.57 
7.26 
7.96 
8.67 
9.39 
10.1 
10.9 
11.6 
12.3 


ләдшпи рә 129465 v st 


HTL) 


тец qons „X JO әпүел ou SƏALF әде) 814) U Jo әпүел ПӘЛІ Р IOA 


NOILNAIYLSIA SYWNOS-IHO ‘SLNIOd 39VIN3OH3d Р 


sr ggepgugqege qq [25 [0/5] 10%] œ% 


00-14 009 ALUNE 


© 


10 
11 
12 
13 
14 


eee ee 
© бо NO tA 


и uL 0 
60 = TP cuu) - (TU + 1) jus le ut E 2 А / = (/)я 


© 2003 Ьу СКС Press LLC 


зе yons f JO әпүел эц) soAIS STU) UL pue U цэлтг) 


NOILNGIYLSIG-4 “SLNIOd 39VIN3OH3d 9011 


ПЕ exeo Duces» T 391.359 [10] œ% 


со 43 009 ALUNE 


© 


10 
11 
12 
13 
14 


eee ee 
© 0 ND tA 


N N 
сл © 


© 2003 Ьу СКС Press LLC 


(с/ч)л(с/ш) д 
(z/(w + u)) I 


560 = tp z/(u+u)- (TU ал Ч) pg fuk fuz jui 


yey yons f JO әп[ел әу) soAIS STY} UL pue U цэл) 


ъ«|1[?2[з3 pm poe uL y pose ico [0f 5o fio] œ% 


00-14 0098 ALUNE 


© 


10 
11 
12 
13 
14 


eee ee 
© 0 ND tA 


N N 
сл © 


© 2003 Ьу СКС Press LLC 


(c/u) (c/u9)1 
(z/(u + u))I, 
jeu yons f JO әпүел әу) SOATS 814) UL pue U цэл) 


'SL6'0 = TP z/(u+u)- (TW + U) g/kg fuz full 


ъ«|1[?2[з3 4p [6[7 БЕ ЖЕ БЕЛІН [0] 5o fio] œ% 


со ŇOU ALUNE 


© 


10 
11 
12 
13 
14 


eee ee 
© 0 ND tA 


N N 
сл © 


© 2003 Ьу СКС Press LLC 


(2/4) 1(7/W)1 
(z/(w + u)) I 


660 = 2р z/(u+u)- (2t + и) 1 c ju Tz fuz jui 


yey qons f JO ONJEA әу) soAIS STY) UL pue U uoAIC) 


ъ«|1[2 [з [4 [5 [6 [7 [5 Пр [5 [1%] œ% 


со 43 С\\л ALUNE 


© 


10 
11 
12 
13 
14 


eee ee 
© со ND tA 


N N 
сл © 


© 2003 Ьу СКС Press LLC 


/ 


(с/ ч) 1(с/ш) 
(/(ш--чУ1; 
jeu yons f JO әпүел әу) SOATS 814) UL pue U цэл) 


`©66°0 = TP z/(u+u)- (TW + U) арар 


© 2003 Ьу СКС Press LLC 


(c/u) (z/w) 
(z/(u + u))I, 
jeu yons f JO әпүел әу) SOATS 814) UL pue U цэл) 


'666'0 = TP c/ (uu) (Ш + U) ара суар 


7.14.6 CUMULATIVE TERMS, BINOMIAL DISTRIBUTION 


Note that B(n, 2; р) = B(n,n — z; 1 — p). 

If pis the probability of success, then B(n, x: р) is the probability of x or fewer 
successes in n independent trials. For example, if a biased coin has a probability 
p = 0.4 of being a head, and the coin is independently ipped 5 times, then there is 
a 68% chance that there will be 2 or fewer heads (since B(5, 2; 0.4) = 0.6826). 
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If A is the rate of Poisson arrivals, then Ғ(ж; A) is the probability of 2 or fewer 
arrivals occurring in a unit of time. For example, if customers arrive at the rate of 
A = 0.5 customers per hour, then the probability of having no customers in any 
speci ed hour is 0.61 (the probability of one or fewer customers is 0.91). 
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Ке тл о = ne o 
И таа араа ара 
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1.000 
1.000 | 1.000 
0.999 | 1.000 
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7.14.8 CRITICAL VALUES, KOLMOGOROV-SMIRNOV TEST 


One- sided test = 0.90 | 0.95 | 0.975 | 0.99 | 0.995 
0. 950 0. 975 0. 990 
0.776 | 0.842 10.900 
0.636 | 0.708 | 0.785 
0.565 | 0.624 | 0.689 
0.509 | 0.563 | 0.627 
0.468 | 0.519 | 0.577 
0.436 | 0.483 | 0.538 
0.410 | 0.454 | 0.507 
0.387 | 0.430 | 0.480 
0.369 | 0.409 | 0.457 
0.352 | 0.391 
0.338 | 0.375 | 0.419 
0.325 | 0.361 |0. 
0.314 | 0.349 | 0.390 
0.304 | 0.338 | 0.377 
0.265 | 0.294 | 0.329 
0.238 | 0.264 | 0.295 
0.218 | 0.242 | 0.270 
0.202 | 0.224 | 0.251 
0.189 | 0.210 | 0.235 


7.14.9 CRITICAL VALUES, TWO SAMPLE 
KOLMOGOROV-SMIRNOV TEST 


The value of D listed below is so large that the hypothesis Но, the two distributions 
аге the same, is to be rejected at the indicated level of signi cance. Here, nı and na 
are assumed to be large, and D = шах |F, (x) — Fna (1)]|. 


Level of signi cance Value of D 
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7.14.10 CRITICAL VALUES, SPEARMAN’S RANK 
CORRELATION 


Spearman s coef cien t of rank correlation, p ,, measures the correspondence between 
two rankings. Let d; be the difference between the ranks of the i" pair of a set of n 
pairs of elements. Then Spearman's rho is de ned as 
657 G zx 65, 

n? —n n? —n 


ps —1— 


where 5, = eae 2: The table below gives critical values for 5, when there is 
complete independence. 


ИЛЕШЕ P056 [V 2099] > 20597] 


7.15 SIGNAL PROCESSING 


7.15.1 ESTIMATION 


Let fe, be a white noise process (so that E [e+] = и, Var [e+] = o”, and Cov [e,, es] = 
0 for s Z t). Suppose that {X;} is a time series. A non-anticipating linear model 
presumes that У o hu Хь, = er, where the {hu} are constants. This can be writ- 
ten H(z)X, = e; where H(z) = Vo haz" and 2" X, = Х,_„. Alternately, 
X, = H-!(z)e,. In practice, several types of models are used: 


1. AR(k), autoregressive model of order k: This assumes that 
A(z) 21 +aız +--+ акгь and so 


X, + ал Х+—1 Spas ap Хъ к = €t. (7.15.1) 
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3. 


1), moving average of order /: This assumes that 
Nz) =14 blz +-++++b,2% and so 


X = e + bie, 21 +... biei. (7.15.2) 


АКМА (Е, 1), mixed autoregressive/moving average of order (k,l): This as- 


sumes that H~1(z) = pie ын. and so 


X, baj Хь +... GR Хь = е + bie 11+ ++ + bier- (7.15.3) 


7.15.2 KALMAN FILTERS 


Kalman ltering is a linear least-squares recursive estimator. It is used when the 
state space has a higher dimension than the observation space. For example, in some 
airport radars the distance to aircraft is measured and the velocity of each aircraft is 
inferred. 


сы ошоо цо н 


. x is the unknown state to be estimated 

‚ X is the estimate of x 

. Zis an observation 

‚ (уе, v} are noise terms 

. {Q, R} are spectral density matrices 

‚ “a ~ N(b,C)” means that the random variable a has a normal distribution 


with a mean of b and a covariance matrix of С. 


. "Extended Kalman Iter’: State propagation is achieved through sequential 


linearizations of the system model and the measurement model. 


. “(—)” is the value before a new discrete observation and “(+)” is the value 


after a new discrete observation 


7.15.2.1 Discrete Kalman Iter 
System model хь = Фр Хр + Wy; wy ~ N(0,0x) 
Measurement model Zk = Нұх, + Vk; vy ~ N(0, Rx) 


Initial conditions [х(0)] = Xo, E [(x(0) — хо)(х(0) — xo)*] 
Other assumptions ТАЙ = 0 for all j and k 


State estimate extrapolation — Хү(-) = 


Error covariance extrapolation P 


2 


-)- 


State estimate update Х,(--) = X&(—) + Как — Нь%ь(—)| 
Error covariance update DP, (+) = [1 — K Hg] Р (—) 


Kalman gain matrix Ky = Px(—) Hg [Hy Pr (—) HG + Rx | re 
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7.15.2.2 Continuous Kalman lter 


System model x(t) = 


Measurement model 

Initial conditions 

Other assumptions 

State estimate propagation x 
Error covariance 


propagation 


Kalman gain matrix 


System model x(t) = f(x(t), t) + w(t); 
Measurement model z(t) = h(x(t)) + v(t); 


Initial conditions х(0) ~ N (Xo, Po) 
Other assumptions Е [w(t)v"(7)| = 0 for all t and all т 


State estimate propagation 
Error covariance propagation 


Gain eguation 


De nition s 


© 2003 by CRC Press LLC 


7.15.2.4 Continuous-discrete extended Kalman lter 


System model x(t) = f(x(t),t) + w(t); w(t) ~ Х(0,000) 
Measurement model zy = Why (Х(16)) + vy; vy ~ N(0, Rx) 
k=1,2,... 


Initial conditions x(0) ~ N (£o, Po) 
Other assumptions ] = 0 for all k and all t 


State estimate propagation 
Error covariance propagation 


State estimate update Xi (+) = Xy (—) + Ky [zk — hi (Xi (—))] 
Error covariance update P (+) = [I — K, Hg (8k (—))] Pe (—) 


Gain matrix K, = Р,(– )H (х k(—)) 
x [Hx Gy (—)) PC-) Hg i (—)) + Re] 


at(x(t),t) 

Ox(t) x(t) =x(t 

ОО 
Ox(t.) 


—1 


De nition s F(x(t),t) = 


Нь(Хь(—)) = 
х(іһ)-хь(-) 


7.15.3 MATCHED FILTERING (WIENER FILTER) 


Let X (t) represent a signal to be recovered, let N (t) represent noise, and let Y (t) = 
X (t) + N (t) represent the observable signal. A prediction of the signal is 


© - [ri K(z)Y (t — z) dz, (7.15.4) 


where К(2) is a ег. The mean square error is E [(X (t) — X; (t))?]; this is mini- 
mized by the optimal (Wiener) Iter Кор(2). 

When X and Y are stationary, de ne their autocorrelation functions as R x x (t— 
s) = E[X(t) X(s)] and Ryy (t — s) = E[Y (t)Y (s)|. If F represents the Fourier 
transform (see page 576), then the optimal lter is given by 


1 F[Rxx(t)] 
Kort) = =. 7.15.5 
For example, if X апа № are uncorrelated, then 
1 FIR t 
SKI = Шхх@) (7.15.6) 


27 FIRxx(1)] + F [Run O] 


In the case of no noise, F | Кор(0)| = +, Kopi(t) = ô(t), and Sy (t) = Y(t). 
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7.15.4 WALSH FUNCTIONS 


The Rademacher functions are de ned by r(x) = sgnsin (2**! ya). If the binary 
expansion of n has the form n = 2% + 2% +... +2’, then the Walsh function of 
order n is И (2) = ri, (2) rin (0)... Ti, (£). 
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7.15.5 WAVELETS 


The Haar wavelet is H(x) = 1if0 < z < 1/2, —11f1/2 < x < 1, and0 otherwise. 
De ne Hj,4(x) = 22/2 H(2/ — k). Then the Haar system, {Hk Y] goo: forms an 
orthonormal basis for the Hilbert space, L? (IR), consisting of functions f with nite 


energy, i.e., | es |f (z)]? dr < oo. 


7.15.5.1 De nitions 


The construction of other wavelet orthonormal bases 44); li o, begins by choos- 
ing real coef cien ts ho, . .. , ^, which satisfy the following conditions (we set hg = 
Oif k «Oork >т): 


1. Normalization: У), hk = у. 

2. Orthogonality: $^, hy hp—2; = Lif j = 0 and 0 if j Z 0. 

3. Accuracy p: Yu OC DF Rh, = 0 forj —0,...,p— 1 with p > 0. 

4. Cohen-Lawton criterion: A technical condition only rarely violated by coef- 
cients which satisfy the normalization, orthogonality, and accuracy p condi- 
tions. 


The terms order of approximation or Strang-Fix conditions are often used in place 
of “accuracy”. The orthogonality condition implies that n is odd. 

The four conditions above imply the existence of a solution р € L?(IR), called 
the scaling function, to the following re nem ent equation: 


plz) = V2 X hr e(2x — k). (7.15.7) 
k—0 


The scaling function has a non-vanishing integral which we normalize: | p(x) dz = 
1. Then y(x) is unique, and it vanishes outside of the interval [0, n]. The maximum 
possible accuracy is р = (n+1)/2. Thus, increasing the accuracy requires increasing 
the number of coef c ients Л. High accuracy is desirable, as it implies that each of 
the polynomials 1, x,..., x?! can be written as an in nite linear combination of the 
integer translates y(x — k). In particular, $^, y(x — k) = 1. Also, the smoothness 
of р is limited by the accuracy; р can have at most n — 2 derivatives, although in 
practice it usually has fewer. 

For each x ed integer j, let V; be the closed subspace of L?(IR) spanned by 
the functions, (94,72... where pj p(x) = 2/2р(2іт — k). The sequence of 
нэн 
1. The subspaces are nested: --- C V 4 C V CM +++. 

2. They are obtained from each other by dilation by 2: v(x) € V; < v(2x) € 
ЕЕ 
. Vo is integer translation invariant: v(x) € Vo «2 v(z +1) € Vo. 
4. The V; increase to all of L?(IR) and decrease to zero: UV; is dense in L? (IR) 
and NV; = {0}. 
5. The set of integer translates {p(x — k)) 17^ ., forms an orthonormal basis 
for Vo. 


subspaces (Vj) forms a multi-resolution analysis for L? (IR), meaning that: 


чә 
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The projection of f(x) onto the subspace V; is an approximation at resolution 
level 277. It is given by /у(2) = V, Cj,k qj (x) with 


22227282 / Т ийй (7.15.8) 


The wavelet 1» is derived from the scaling function y by the formula, 


(a) = У2 M gx (22 — k), | where gy = (—1)* hs... (7.15.9) 
k—0 


The wavelet % has the same smoothness as р, and the accuracy p condition implies 
vanishing moments for 0: f 2040(2) dx = 0 for j = 0,...,p — 1. The functions 
40), (£) = 2/21)(2 x — k) are orthonormal, and the entire collection (wj. Кусс 
forms an orthonormal basis for L? (IR). 

With j x ed, let W; be the closed subspace of L? (R) spanned by (272 — k) 
for integer k. Then V; and W are orthogonal subspaces whose direct sum is У;-1. 
Let f be a function and let p; = 2,4; vj, (x) be its projection onto W;, where 
dik = (fj). Then the approximation f;,; with resolution 27011) is фу = 
fi + pj, the sum of the approximation f; at resolution 277 and the additional ne 
details p; needed to give the next higher resolution level. 

The discrete wavelet transform is an algorithm for computing the coef cien ts 
суд, and 4; from the coef cients cj+1,. It can also be interpreted as an algorithm 
dealing directly with discrete data, dividing data c j+1, into a low-pass part су, and 
a high-pass part а; ь. Speci cally , 


Cjl = Ж hg Cj+1,k and йы = У 96—21 Cj+1,k- (7.15.10) 
k k 


The inverse transform is 


Cite = >, hea бы +) gk-zi di (7.15.11) 
1 1 


The discrete wavelet transform is closely related to engineering techniques known as 
sub-band coding and quadrature mirror ltering . 


EXAMPLE The Daubechies family. For each even integer N > 0, there is a unique 
set of coef cients Ло,...,Ам-1 which satisfy the normalization and orthogonality 
conditions with maximal accuracy р = N/2. The corresponding g and % are the 
Daubechies scaling function Dn and Daubechies wavelet Wn. The Haar wavelet 
Н is the same as the Daubechies wavelet И. For the Haar wavelet, the coef - 
cients are ho = hi = 1/У2 and the subspace V; consists of all functions which аге 
piecewise constant on each interval (5277, (k + 1)279). The coef cients for D4 are: 
ho = (1+ V3)/(4V2), hi = (3 + V3)/(4V2), ha = (3 — V3)/(4V2), and hs = 
(1 — V3) /(4v2). 


7.15.5.2 Generalizations 


For a given number of coef cien ts, the Daubechies wavelet has the highest accuracy. 
Other wavelets reduce the accuracy in exchange for other properties. In the Coi et 
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family the scaling function and the wavelet possesses vanishing moments, leading to 
simple one-point quadrature formulae. The “least asymmetric” wavelets are close to 
being symmetric or antisymmetric (perfect symmetry is incompatible with orthogo- 
nality, except for the Haar wavelet). 

Wavelet packets are libraries of basis functions de ned recursively from the scal- 
ing functions ф and v. The Walsh functions are wavelet packets based on the Haar 
wavelet. 

Allowing in nitely many coef cien ts results in wavelets supported on the entire 
real line. The Meyer wavelet is band-limited, possesses in nitely many derivatives, 
and has accuracy р = oo. The Battle-Lemarié wavelets are piecewise splines and 
have exponential decay. 

M -band wavelets replace the ubiquitous dilation factor 2 by another integer M. 
Multiwavelets replace the coef cien ts hg by r x r matrices and the scaling function 
and wavelet by vector-valued functions (y1,...,,) and (%1,..., Wr), resulting in 
an orthonormal basis for L? (IR) generated by the several wavelets ^4 , . . . , Wp. 

For higher dimensions, a separable wavelet basis is constructed via a tensor 
product, with scaling function (x)q(y) and three wavelets (ж) (у), v(x)v(y), 
wW(x)w(y). Non-separable wavelets replace the dilation factor 2 by a dilation matrix. 

Biorthogonal wavelets allow greater e xibility of design by relaxing the require- 
ment that the wavelet system fw) form an orthonormal basis to requiring only 
that it form a Riesz basis. The Cohen—Daubechies—Feauveau wavelets are symmet- 
ric and their coef cien ts hy are dyadic rationals. The Chui-Wang-Aldroubi-Unser 
semiorthogonal wavelets are splines with explicit analytic formulae. 

The basis condition may be further relaxed by allowing (wv ;,;,} to be a frame, an 
over-complete system with basis-like properties. Introducing further redundancy, the 
continuous wavelet transform uses all possible dilates and translates a!/?%)(ax + b). 


7.15.5.3 Wavelet coef cients and gures 


Coef cients for Daubechies scaling functions! 


Də: ho: 0.707106781187 Dg: ho: 0.332670552950 
hy: 0.707106781187 hy: 0.806891509311 

he: 0.459877502118 

Пі: ho: 0.482962913145 ha: —0.135011020010 
hy: 0.836516303738 ha: —0.085441273882 

һә: 0.224143868042 hs: 0.035226291886 


ha: -0.129409522551 


!The tables and gures shown below are reprinted with permission from Daubechies, I., Ten Lectures 
on Wavelets. Copyright ©1992 by the Society for Industrial and Applied Mathematics, Philadelphia, PA. 
All rights reserved. 
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Ds 


Dg: 


0.230377813309 
0.714846570553 
0.630880767930 
—0.027983769417 
—0.187034811719 
0.030841381836 
0.032883011667 
—0.010597401785 


0.160102397974 
0.603829269797 
0.724308528438 
0.138428145901 
—0.242294887066 
—0.032244869585 
0.077571493840 
—0.006241490213 
—0.012580751999 
0.003335725285 
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Wg > 


0.111540743350 
0.494623890398 
0.751133908021 
0.315250351709 
—0.226264693965 
—0.129766867567 
0.097501605587 
0.027522865530 
—0.031582039317 
0.000553842201 
0.004777257511 
—0.001077301085 
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information presented in this chapter. 
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8.1 BASIC NUMERICAL ANALYSIS 


8.1.1 APPROXIMATIONS AND ERRORS 


Numerical methods involve nding approximate solutions to mathematical prob- 
lems. Errors of approximation can result from two sources: error inherent in the 
method or formula used and round-off error. Round-off error results when a calcu- 
lator or computer is used to perform real-number calculations with a nite number 
of signi cant digits. All but the rst speci ed number of digits are either chopped or 
rounded to that number of digits. 

If p* is an approximation to p, the absolute error is de ned to be |p — p*| and 
the relative error is |p — p*|/|p|, provided that р Z 0. 

Iterative techniques often generate sequences that (ideally) converge to an exact 
solution. It is sometimes desirable to describe the rate of convergence. 


DEFINITION 8.1.1 


Suppose lim By, = O andlim ay, = a. Ifa positive constant K exists with |an — a| < 
К |n] for large n, then {a} is said to converge to a with a rate of convergence 
O( By). This is read “big oh of Bn” and written аң = a+ О(8,). 


DEFINITION 8.1.2 


Suppose (pa is a sequence that converges to р, with pn # р, for all n. If positive 


[Dn+1 — P| 


constants A and a exist with lim Б = A then {pn} converges to p of 


| | поо |р — p 
order a, with asymptotic error constant A. 


In general, a higher order of convergence yields a more rapid rate of conver- 
gence. A sequence has linear convergence if a — 1 and quadratic convergence if 
a = 2. 


8.1.1.1 Aitken's A? method 


DEFINITION 8.1.3 


Given {рһ}©°_у, the forward difference Ap, is de ned by Ар, = pui — рь, for 
n > 0. Higher powers Ар, are de n ed recursively by Ар = /N(/*-1p,), for 
k > 2. In particular, Ap, = A(Dn+1 — Pn) = Pn+2 — 2pn41 + Pn: 


If a sequence {ppn } converges linearly to p and (p, — p)(Dn—1 — p) > 0, for 
suf ciently large n, then the new sequence {pn} generated by called Aitken's A? 
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method, 


т (A pn)“ 
Pn = Dn — “Ар (8.1.1) 
for all n > 0, satis es lim, зоо cR 0. 
—p 


8.1.1.2 Richardson's extrapolation 


Improved accuracy can be achieved by combining extrapolation with a low-order 
formula. Suppose the unknown value M is approximated by a formula N(h) for 
which 


M = N(h) + Kih + Koh? + Koh? +... (8.1.2) 
for some unspeci ed constants K 4, К, K3,.... To apply extrapolation, set №; (Л) = 
N (h), and generate new approximations N ; (h) by 

h\ 5-1 (2) - Nj-i(9) 
N,(h) = Nj-1 (5) + TITO TT (8.1.3) 


Then M = N;(h) + O(h?). A table of the following form is generated, one row at 
a time: 


№ (55) No(h) 
№ (Ва) No (Bh) Na(h) 
М (38) № (B/s) Мз(35) Na(h). 


Extrapolation can be applied whenever the truncation error for a formula has the 
form > K;h° + O(h%™) for constants K; and aj < o» < +++ < am. In 
particular, if aj = 27, the following computation can be used: 


h N,_1 (E) — N;_1(h 
N;(h) = №1 (5) + ты шини (8.1.4) 


and the entries in the j column of the table have order O(h 9). 


8.1.2 SOLUTION TO ALGEBRAIC EGUATIONS 


Iterative methods generate sequences {pn that converge to a solution p of an equa- 
tion. 


DEFINITION 8.1.4 


A solution p of f(x) = 0 is a zero of multiplicity m if f (a) can be written as f(x) = 
(x — p)™ q(x), for x # p, where lim, sp q(x) # 0. A zero is called simple if m = 1. 
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8.1.2.1 Fixed point iteration 
A xed point p for a function g satis es g(p) = p. Given po, generate {рь} by 


Pn+1 = g(ps) forn > 0. (8.1.5) 


If {pn } converges, then it will converge to a x ed point of g and the value р„ can 
be used as an approximation for p. The following theorem gives conditions that 
guarantee convergence. 


THEOREM 8.1.1 (Fixed point theorem) 


Let g € Cla, b] and suppose that g(x) € [a,b] for all x in [a,b]. Suppose also that 
g exists on (a,b) with |g'(z)| € k < 1, for all x € (a,b). If po is any number 
in [a,b], then the sequence de ne d by Equation (8.1.5) converges to the (unique) 
xed point p in [a,b]. Both of the error estimates |p, — p| < Ет [Do = pi| and 
[рь = p| € Ё®тах{ро — a,b — po} hold, for all n > 1. 


The iteration sometimes converges even if the conditions are not all satis ed. 


THEOREM 8.1.2 


Suppose g is a function that satis es the conditions of Theorem 8.1.1 and g' is also 
continuous on (a,b). If g'(p) 4 0, then for any number po in [a,b], the sequence 
generated by Equation (8.1.3) converges only linearly to the unique xed point p in 
la, b]. 


THEOREM 8.1.3 


Let p be a solution of the equation x = g(x). Suppose that g'(p) = 0 and g" are 
continuous and bounded by a constant on an open interval I containing p. Then 
there exists а 6 > 0 such that, for po € [p — 6,p + $], the sequence de ned by 
Equation (8.1.5) converges at least quadratically to p. 


8.1.2.2 Steffensen’s method 


For a linearly convergent x ed-point iteration, convergence can be accelerated by 
applying Aitken’s A? method. This is called Steffensen’s method. De ne po = po. 
compute p = 931%?) and po) = (90). Set р = Po which is computed using 
Equation (8.1.1) applied to po А рй), апа pP. Use x ed-point iteration to compute 


p” and р? and then Eguation (8.1.1) to nd pe. Continuing, generate (pt? }. 


THEOREM 8.1.4 


Suppose that x = g(x) has the solution p with g" (р) # 1. If there exists ад > 0 such 
that g € C? [p — ô, p + ô], then Steffensen’s method gives quadratic convergence for 


the sequence (151 for any po € [p — ô, p + ô]. 
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FIGURE 8.1 
Illustration of Newton"s method." 
у А 


Slope f (p) у= f(x) 


‚ (р, fip» 


си f (ро) 
р > 


Pi 


PO 


(ро, Хро)) 


8.1.2.3 Newton-Raphson method (Newton’s method) 


To solve f(a) = 0, given an initial approximation po, generate {рь } using 


2 M f (Pn) 
Pn+1 = Pn f'n) , 


for n > 0. (8.1.6) 


Figure 8.1 describes the method geometrically. Each value рф represents the 
x-intercept of the tangent line to the graph of f(x) at the point |р,, f (Dn)]. 


THEOREM 8.1.5 


Let f € C?[a,b]. If p € [a,b] is such that f (p) = 0 and f'(p) # 0, then there exists 
a 5 > 0 such that Newton's method generates a sequence {pn} converging to p for 
any initial approximation po € [p — ô, p + 6]. 


Note: 


1. Generally the conditions of the theorem cannot be checked. Therefore one 
usually generates the sequence {p,,} and observes whether or not it converges. 

2. An obvious limitation is that the iteration terminates if f'(pn) = 0. 

3. For simple zeros of f, Theorem 8.1.5 implies that Newton's method converges 
quadratically. Otherwise, the convergence is much slower. 


!From R.L. Burden and J.D. Faires, Numerical Analysis, 7th ed., Brooks/Cole, Pacic Grove, CA, 
2001. With permission. 
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8.1.2.4 Modied Newton’s method 


Newton’s method converges only linearly if р has multiplicity larger than one. How- 
ever, the function u(x) = ae has a simple zero at p. Hence, the Newton iteration 
formula applied to u(x) yields quadratic convergence to a root of f(x) = 0. The 
iteration simpli es to 


Жон) (ол) 


тыд 00004. Чыл 


Pn+1 = Pn — 


8.1.2.5 Secant method 


To solve f(x) = 0, the secant method uses the x-intercept of the secant line passing 
through (pr, f (Dn)) and (psi, f(Pn—1)). The derivative of f is not needed. Given 
Ро and рт, generate the sequence with 


(Pn x: Dn—1) 


Пле 00.5 (8.1.8) 


Pn+1 = Юа — /( n) 


8.1.2.6 Root-bracketing methods 


Suppose f(a) is continuous on [a,b] and f(a)f(b) < 0. The Intermediate Value 
Theorem guarantees a number p € (a,b) exists with f(p) — 0. A root-bracketing 
method constructs a sequence of nested intervals | ёр, bn], each containing a solution 
of f(x) = 0. At each step, compute р, € [an, bn] and proceed as follows: 


If f (py) = 0, stop the iteration and р = py. 
Else, 


if fan) f (Pn) < 0, then set An+1 = аһ, боза — Dn. 
Else, set а,аі = pn. Раф = by. 


8.1.2.7 Bisection method 


This is a special case of the root-bracketing method. The values p „ are computed by 


Pa = an + fn +, forn > 1. (8.1.9) 


Clearly, |р, — p| < (b — a)/2” for n > 1. The rate of convergence is 0(27"). 
Although convergence is slow, the exact number of iterations for a speci ed accuracy 
є can be determined. To guarantee that |p v — p| < e, use 


= In(b — a) —1 
N > log, (2) = _ (8.1.10) 


8.1.2.8 False position (regula falsi) 


bn — An 
Pn = bn — Р у (ас) 


This root-bracketing method also converges if the initial criteria are satis ed. 


forn > 1. (8.1.11) 
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8.1.2.9 Horner's method with de ation 


If Newton's method is used to solve for roots of the polynomial P(x) = 0, then 
the polynomials P and P' are repeatedly evaluated. Horner's method ef ciently 
evaluates a polynomial of degree n using only n multiplications and n additions. 


8.1.2.10  Horner's algorithm 


To evaluate P(x) = ant" + as 12" 71 +... + ао and its derivative at то: 
INPUT: degree n, coef cien ts 4а0,41,...,аҺ Б tto, 
OUTPUT: y = P(zo); z = Р. (zo). 
Algorithm: 


І. Sety = an; 2 = аһ. 
2. Forj =n — l,n —2,...,1, 
set y = Toy + aj; 2 = Toz t y. 
3. Sety = roy + 00. 
4. OUTPUT (y, z). STOP. 


When satis ed with the approximation 21 for a root x1 of P, use synthetic 
division to compute Q(x) so that P(x) ~ (x —21)Q1(x). Estimate a root of Qı (x) 
and write P(x) as (x — £1)(a@ — 72)0>(>), and so on. Eventually, Q n—2(x) will be 
a quadratic, and the quadratic formula can be applied. This procedure, nding one 
root at a time, is called de a tion. 

Note: Care must be taken since 21 is an approximation for 21. Some inaccuracy 
occurs when computing the coef cients of Q 1 (x), etc. Although the estimate Тэ of a 
root of Q (a) can be very accurate, it may not be as accurate when estimating a root 
of P(x). 


8.1.3 INTERPOLATION 


Interpolation involves tting a function to a set of data points (20, уо), (21,41), 
‚..› (£n, Yn). The x, are unique and the y; may be regarded as the values of some 
function f(x), that is, y; = f(x;) fori = 0,1,...,n. The following are polynomial 
interpolation methods. 


8.1.3.1 Lagrange interpolation 


The Lagrange interpolating polynomial, denoted P„ (x), is the unique polynomial of 
degree at most n for which Р,(а,) = / (ть) fork =0,1,...,n. Itis given by 


Р(х) = X (гь)Гад (8) (8.1.12) 
k—0 
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where (xo, ..., 24) are called node points, and 


(x — zo)(z — zi): (x  z&i)($ — жаа) (z — Zn) 


Dakt) = 
жа) (жь — жо)(жь p) а-а А ата (Ek — Tn) 
= диел. чылыы кай з (8.1.13) 
содон ӨВ T 24) 


THEOREM 8.1.6 (Error formula) 


If £o, £1,- . - , £n are distinct numbers in [a,b] and f € С" [a,b], then, for each x 
in [a,b], a number (ж) in (a,b) exists with 
A fe (Ea) 
f(z) = P(x) + СЕЗІ (ж — zo)(z — 21) (2 — £n), (8.1.14) 


where P is the interpolating polynomial given in Equation (8.1.12). 


Although the Lagrange polynomial is unique, it can be expressed and evaluated 
in several ways. Equation (8.1.12) is tedious to evaluate, and including more nodes 
affects the entire expression. Neville's method evaluates the Lagrange polynomial at 
a single point without explicitly ndin g the polynomial and the method adapts easily 
when new nodes are included. 


8.1.3.2 Neville's method 


Let Pmı,m2,...,m, denote the Lagrange polynomial using distinct nodes (2), 2то» 
..., Zm, }. If P(x) denotes the Lagrange polynomial using nodes 120,21,...,2%) 
and x; and x; are two distinct numbers in this set, then 


(x p Pon. paged. GE) — (x — m Po des, a n) 


Pues (x; — zj) 


(8.1.15) 


8.1.3.3 Neville's algorithm 

Generate a table of entries Q; for 7 > O and 0 < i < j where the terms are 
Qij = Pi-j4—j41,...,i-1,1- Calculations use Equation (8.1.15) for a speci c value 
of x as shown: 


то Qoo = Po 

21 ©о=Р, Qi = Бод 

22 Qoo=P Q21 = Ві) Qo = Po 

із Q30=P3 Q31 = Боз Оза- P23 ©зз = Po, 


Note that P; = P(x) = f(x) and {Q;,;} represents successive estimates of f(x) 
using Lagrange polynomials. Nodes may be added until |Q ;,; — Qi-1,;-1| < € as 
desired. 
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8.1.3.4 Divided differences 


Some interpolation formulae involve divided differences. Given an ordered seguence 
of values, fr, 1, and the corresponding function values f(z ;), the zero" divided dif- 
ference is f[x;] = f(x;). The ғ st divided difference is de ned by 


Fimi) — fie) _ Feni] — fled. 


ЇЇ аа нэгтээ. (8.1.16) 
Liq. — Ti Lig — Ti 
The k" divided difference is de ned by 
fts dudes SK 
= Т see ree ere Lipk] EA шин (8.1.17) 


Ti+k — Ti 


Divided differences are usually computed by forming a triangular table. 


First Second Third 
f(x) | divided differences | divided differences | divided differences 


x 
zo f [£o 


Джо, x1] 

21 А1] flzo, 21,22] 

flx1, x2] flto, 21, 12, 23] 
T2 Дә] flx1, 2, 73] 


Дз, 13] 


x3 з] 


8.1.3.5 Newton's interpolatory divided-difference formula 


(also known as the Newton polynomial) 


Р.(а)- f[xo] + У f[zo.21, 1.2, UR] (z — zo) (x — tx 1). (8.1.18) 
k—1 


Labeling the nodes as (4, Ľn—1,- - - zo], a formula similar to Equation (8.1.18) 
results in Newton"s backward divided-difference formula, 


Р,(а) = flen] + flan, tn—1](@ — ти) 
+ f[z5, 25-1, En—2|(@ — n)(@ — Zn 1) (8.1.19) 
+... + flan, tn—1,.--,Xo|(@ — En) + (£ — 71). 


If the nodes are equally spaced (that is, r, — ©, 1 = М), de ne the parameter 
s by the equation x = ro + sh. The following formulae evaluate P,,(x) at a single 
point: 


1. Newton’s interpolatory divided-difference formula, 


Р(х) = Р, (zo + sh) = V Н kl“ f [zo 23, .. ., ax]. (8.1.20) 
k=0 


© 2003 by CRC Press LLC 


2. Newton’s forward-difference formula (Newton-Gregory), 


Р(х) = Palto + sh) = V Ө AF Қ). (8.1.21) 


k—0 


3. Newton-Gregory backward formula (ts nodes x_,, to zo), 


Pule) = flao) + (1) A 16-0 (57) A? 16-2 
E ше ) A” }(а_һ). (8.1.22) 
4. Newton's backward-difference formula, 
P,(a) = ЖЕН ей vt flan), (8.1.23) 


where ү" f (z,,) is the k! backward difference, de ne d for a sequence {pn}, 
by VPn = Pn — Pn—1 for n > 1. Higher powers are de ned recursively by 
Vp, = 7(V*~! pn) for k > 2. For notation, set V “py, = Pn. 


5. Stirling’s formula (for equally spaced nodes x _m, ..., x 31, Z0, 21, ... Tm), 


Py (2) = Passa (a) = fleo) + Z liso] Ла 
s(s? — 1)А? 
2 
T... 8*(s? — 1)(s? — 4)... (82 — (m — 1)?) P?" fle s... 2m] 

s(s? — 1) (s? — m?)h?™+! 


4Э--2-Э5--(Даааа. etitm EE Ie fis -,£m41])- 


s?h? flex 1,70, 21] s (f[z-2, € 21, to, m] + f[z 21, £o, £1, 22]) 


Use the entire formula if n = 2m + 1 is odd, and omit the last term if n = 2m 
is even. The following table identi es the desired divided differences used in 
Stirling's formula: 


First divided | Second divided Third divided 
differences differences differences 
f (> -2,2-1 | 


7 сал £0] 


Де—1,2о] fle-2, £1, z0, x1] 
Tg, £o, £1] 

Джо, 21] f[x 1,20, 21,22] 
Джо, 21, 23] 


1,2] 
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8.1.3.6 Inverse interpolation 


Any method of interpolation which does not require the nodes to be equally spaced 
may be applied by interchanging the nodes (2: values) and the function values (у 
values). 


8.1.3.7 Hermite interpolation 


Given distinct numbers {%9,21,...,%n}, the Hermite interpolating polynomial for 
a function f is the unique polynomial Н (x) of degree at most 2n + 1 that satis es 
A(a;) = f (zi) and H'(z;) = f (11) foreach = 0,1,...,n. 

A technique and formula similar to Equation (8.1.18) can be used. For distinct 
nodes [zo,21, isl n]. de ne 20. 21,-3- Žon +11 by 202) — 22441 = Ti for i = 
0,1,...,n. Construct a divided difference table for the ordered pairs (2 ;, f(z;)) 
using f'(x;) in place of f[z2;, 22:41], which would be unde ned. Denote the Hermite 
polynomial by H2n41(x). 


8.1.3.8 Hermite interpolating polynomial 
2п+1 
Нәя+1(®) = Дао] + M fleo z1,- -s 2%] (@ — 20): (@ — 2-1) 
k—1 


= flzo] + Ро, z1](z — xo) + flžo, 21, z2] (a — то)? (8.1.24) 
+ fleo, 21, 22, 23] (© — то) (z — x1) 
+... + f[z0,..-,22n41](@ — £0)? +++ (£ — rn 1) (£ — £n). 


THEOREM 8.1.7 (Error formula) 
If f € C?"*?[a, b], then 


fOrt?) (£(z)) 


Grape (2—90) (8-0) (8125) 


f(x) = Honji(x) + 


for some £(x) € (a,b) and where x; € [a,b] for each à = 0,1,...,n. 


8.1.4 FITTING EGUATIONS TO DATA 
8.1.4.1 Piecewise polynomial approximation 


An interpolating polynomial has large degree and tends to oscillate greatly for large 
data sets. Piecewise polynomial approximation divides the interval into a collec- 
tion of subintervals and constructs an approximating polynomial on each subinter- 
val. Piecewise linear interpolation consists of simply joining the data points with 
line segments. This collection is continuous but not differentiable at the node points. 
Hermite polynomials would require derivative values. Cubic spline interpolation is 
popular since no derivative information is needed. 
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DEFINITION 8.1.5 


Given a function f de ned on [a,b] and a set of numbers а = то < zı < ... 


ға = b, a cubic spline interpolant, S, for f is a function that satis es 


« 


1. S is a piecewise cubic polynomial, denoted S, on [2;, 2341] for each j = 


Gitane, 

S(x;) = f(a;) for each j =0,1,...,n 
Sjzi(zj41) = 5;(жу+1) for each j =0,1,...,n — 2. 
Saal ) = Si(zj.1) for each 7 = 0,1,...,п — 2. 
Súp rj) = S; (1441) for each j = 0,1,...,n — 2. 


141 


о WR м 


. One of the following sets of boundary conditions is satis ed: 


(a) S" (xo) = S"(x4) 30 (free or natural boundary), 


(b) 5'(хо) = f'(xo) and 5'(х„) = f (an) (clamped boundary). 


If a function f is de ne d at all node points, then f has a unique natural spline 
interpolant. If, in addition, f is differentiable at a and b, then f has a unique clamped 


spline interpolant. To construct a cubic spline, set 


Sj(z) = aj + bj(x — 23) + су(а— x4)“ + dj (x — m5) 


for each j = 0,1,...,n — 1. The constants {a;,b;,c;, dj} are found by solving a 
tridiagonal system of linear equations, which is included in the following algorithms. 


8.1.4.2 Algorithm for natural cubic splines 
INPUT: n, {20,21,---,2n}, 
ag = J (xo), а= аз). e On = Хан). 
OUTPUT: {a,;,6;,c;,d;} for j = 0,1,...,п — 1. 
Algorithm: 


1. Fori = 0,1,...,n — 1, set h; = др — zi. 


3 
2. Fori = 1,2,...,n—1,seta; = 7, (ait 701) — 
i 


3. Set lo = 1, ро = 0, 20 = 0. 
4. Fori =1,2,...,n—1, 
set l; = 2(zi41 — 23-1) — hi 1/11, 
set и = hifi; 
set z; = (o — hi zi 1)/ Fi. 
5. Set 2, = 1,2, = 0, сь = 0. 
бог = sd ess ТТ 
set c; = Zj — UjCi 1: 
set bj = (aj41 — aj) /hj — (с + 263) /3; 
set dj = (су+1 — cj)/ (3h;). 


7. OUTPUT (aj, bj,cj, dj for j = 0,1,...,п — 1). STOP. 
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8.1.4.3 Algorithm for clamped cubic splines 
INPUT: n, [290,21,..., En}, 
ao = f(zo), a1 = f(z1),..., a. = Кан). 
Fo = flm), Fn = f (zn). 
OUTPUT: {a;,b;,c;,d;} for j = 0,1,...,n — 1. 


Algorithm 
1. Fori = 0,1,...,n — 1, set hi = vj41 — Tx. 
2. Set ag = 3(a1 — ag)/ ho — ЗР, An = ЗЕ, - (аа — An 1) / ha i. 
3 3 
3. Fori = 1,2,...,n—1, seta; = — (а —aj) — (aj — aj—1). 
hi hia 


4. Set бу = 2ho, ро = 0.5, zo = ag/£o. 

5. Fori =1,2,...,n— 1, 
set £j = 2(ziy1 — zi-1) — hi 11141: 
set и = hifi; 
set z; = (о; — hi zi 1)/ Fi. 


6. Set ln = ha —1 (2 — из-1) Zn = (Qn — һ—12һ—1)/бл. Cn = 2. 
7. Еогў=п—1,п—2,...,0, 

set Cj = Zj — Шуур 

set bj = (aj41 — aj) /hj — (у + 2c)/3; 

set dj = (cji — cj)/ (3h;). 
8. OUTPUT (a;,b;, cj, d; for j = 0,1,...,n — 1). STOP. 


8.1.4.4 Discrete approximation 

Another approach to t a function to a set of data points ((z;, y;) | i = 1,2,...,m] 

is approximation. If a polynomial of degree n is used, the polynomial P,(x) = 

Y io ба is found that minimizes the least-squares error E = Y [yi Pale). 
To nd 4ао,41,..., ау}, solve the linear system, called the normal equations, 


created by setting partial derivatives of E taken with respect to each a , equal to zero. 
The coef cien t of ag in the rst equation is actually the number of data points, m. 


8.1.4.5 Normal equations 


m m m m m 

0 1 2 0 

а У 29 + а У 21+ о У 22+... + аһ У S VTi, 
i21 i21 i21 i21 i21 


m m m m m 
1 2 3 1 1 
ao Dai +а ууа tar 3. Жадау" — P їнї, (4126) 
ї=1 ї=1 і-1 ї=1 ї=1 


m m m m ` m 
1 2 2 
ao › ж + a1 > qs + a» › xet +... + ад > үлэг > yit; . 
i=1 i=1 i=1 i=1 i=1 
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Note: Р,(т) can be replaced by a function f of speci ed form. Unfortunately, to 
minimize Е, the resulting system is generally not linear. Although these systems can 
be solved, one technique is to “linearize” the data. For example, if y = f(x) = Бе, 
then Iny = lnb + ax. The method applied to the data points (x;,ln y;) produces 
a linear system. Note that this technique does not nd the approximation for the 
original problem but, instead, minimizes the least-squares for the “linearized” data. 


8.1.4.6 Best-t line 


Given the points P, = (21,11), P» = (#2,y2), ..., Pn = (£n, уһ), the line of 
best- t is given by y — y = m(x — Т) where 


[e (zi +29 +... + Zn) 
n, ^ 
121 


T= , 
n 

lx (yı ++... t ys) 

gc» y mM (8.1.27) 


1-1 
_ (тил эр +... лай») -NTF Ty — YU 


8.2 NUMERICAL LINEAR ALGEBRA 


8.2.1 SOLVING LINEAR SYSTEMS 


The solution of systems of linear eguations using Gaussian elimination with back- 
ward substitution is described in Section 8.2.2. The algorithm is highly sensitive 
to round-off error. Pivoting strategies can reduce round-off error when solving an 
n x n system. For a linear system Ax = b, assume that the equivalent matrix equa- 


tion A“) x = b) has been constructed. Call the entry, а, the pivot element. 


8.2.2 GAUSSIAN ELIMINATION 


To solve the system Ax = b, Gaussian elimination creates the augmented matrix 


011 men Gin by 
A! = [A : b] — | : ЭМ" (8.2.1) 


Gn] --- Ann bn 


This matrix is turned into an upper-triangular matrix by a sequence of (1) row per- 
mutations, and (2) subtracting a multiple of one row from another. The result is a 
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matrix of the form (the primes denote that the quantities have been modi ed) 


а аз .. а, bi 

0 а» ... а, Ы, 
| (8.22) 

0 ... 0 a b 


This matrix represents a linear system that is equivalent to the original system. If 
the solution exists and is unique, then back substitution can be used to successively 
determine (25, 4 3,...]). 


8.2.3 GAUSSIAN ELIMINATION ALGORITHM 


INPUT: number of unknowns and equations n, matrix А, and vector b. 
OUTPUT: solution x = (r1,...,£n)! to the linear system Ax = b, 

or message that the system does not have a unique solution. 
Algorithm: 


1. Construct the augmented matrix A’ = [A : b] = (a! 5) 
2. For? = 1,2,...,n — 1 do (a)-(c): (Elimination process) 
(a) Let p be the least integer with i < p < n and a5; # 0 


If no integer can be found, then 
ООТРОТ (по unique solution exists"). STOP. 


(b) If p Æ i interchange rows р and i in A’. Call the new matrix A". 
(c) Forj = 4 + 1,...,n do i-i: 
i. Set Mij = аң/ан. 
ii. Subtract from row j the quantity (m ,j times row i). 
Replace row ) with this result. 


Та”, = 0 then OUTPUT (“по unique solution exists"). STOP. 


‚ Set £n = a, „1/9: (Start backward substitution). 


d ml" _yn ЖОЛУ, ! 
. Fori =n — 1,...,2,1 set x, = «лаа У jua Uz Tj | / ai 


ON л A о 


. OUTPUT (21,..., £n ), (Procedure completed successfully). STOP. 


8.2.4 PIVOTING 


8.2.4.1 Maximal column pivoting 

Maximal column pivoting (often called partial pivoting) nds, at each step, the ele- 
ment in the same column as the pivot element that lies on or below the main diagonal 
having the largest magnitude and moves it to the pivot position. Determine the least 


р > k such that Dh | = MAX/<i<n af? and interchange the k“ equation with the 


р" equation before performing the elimination step. 
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8.2.4.2 Scaled-column pivoting 


Scaled-column pivoting sometimes produces better results, especially when the el- 
ements of A differ greatly in magnitude. The desired pivot element is chosen to 
have the largest magnitude relative to the other values in its row. For each row 
de ne a scale factor s; by s; = maxi<j<n laij|. The desired pivot element at 


the k“ step is determined by choosing the smallest integer p with Dh | /8р = 


k 
afe /5j- 


MAX/<j<n 


8.2.4.3 Maximal (or complete) pivoting 


The desired pivot element at the k“ step is the entry of largest magnitude among 
[aij] with i = k,k +1,...,n andj = k,k +1,...,n. Both row and column 
interchanges are necessary and additional comparisons are required, resulting in ad- 
ditional execution time. 


8.2.5 EIGENVALUE COMPUTATION 
8.2.5.1 Power method 


Assume that the n x n matrix A has n eigenvalues (A1, Ав, An} with linearly 
independent eigenvectors (v 0), v, у}, Assume further that A has a unique 
dominant eigenvalue А1, that is |А | > |As] > |Аз| > +++ > [An]. Note that for any 
хє В", x= Хал ajv9), 

The algorithm is called the power method because powers of the input matrix 
аге taken: lim ,54 A*x = Іт е Ао үй), However, this seguence converges to 
zero if |А1| < 1 and diverges if |А | > 1, provided o; 4 0. Appropriate scaling of 
Дех is necessary to obtain a meaningful limit. Begin by choosing a unit vector х © 
having a component a) such that „4 sl |хФ ME 

The algorithm inductively constructs sequences of vectors {x Gn) M апа 
{y(™ 199. A and a sequence of scalars (7) 199. Бу 


(m) — дұіт-1) (m) — (m) (m 2 V 
y = Ax : H = Ypma? X = EC (8.2.3) 
Yom 
where, at each step, pm represents the least integer for which Du | = | y"? | T 


The sequence of scalars satis es limmo u") = M, provided а Z 0, and 
the sequence of vectors (x?) 1??  converges to an eigenvector associated with Аі 
that has leo norm one. 


8.2.5.2 Power method algorithm 
INPUT: dimension n, matrix A, vector x, tolerance TOL, and 
maximum number of iterations N. 
OUTPUT: approximate eigenvalue и, 
approximate eigenvector x (with ||х|| „ = 1), 
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or a message that the maximum number of 
iterations was exceeded. 
Algorithm: 


1. Set k21. 
2. Find the smallest integer p with 1 < p < n and || = ||x||.... 
3. Set X = х/т. 
4. While (k < №) do (a)- (g): 
(a) Sety = Ах. 
(b) Set u = yp. 
(c) Find the smallest integer p with 1 < p < n and |yp| = ||у||. 
(d) If yp = 0 then OUTPUT (^Eigenvector", x, “corresponds to 
eigenvalue 0. Select a new vector x and restart"); STOP. 
(e) Set ERR = |х — y/Ypl| 23 x = ¥/Yp- 
(f) If ERR < TOL then OUTPUT (и,х) 
(procedure successful) STOP. 


(g) Stk = k + 1. 


5. OUTPUT (*Maximum number of iterations exceeded"). STOP. 


Notes: 


1. The method does not really require that A: be unique. If the multiplicity is 
greater than one, the eigenvector obtained depends on the choice of x (9), 

2. The sequence constructed converges linearly, so that Aitken's A? method 
(Equation (8.1.1)) can be applied to accelerate convergence. 


8.2.5.3 Inverse power method 


The inverse power method modi es the power method to yield faster convergence 
by nding the eigenvalue of A that is closest to a speci ed number q. Assume that 
A satis es the conditions as before. If g Æ Aj, fori = 1,2,...,n, the eigenvalues 
of (A — 41) are nce а a хос with the same eigenvectors у(1),...,у("). 
Apply the power method to (A — qI)~!. At each step, у" = (A — qI)-1xCn-V, 
Generally, y") is found by solving (A — al)y v) = x("—1) using Gaussian elimi- 
nation with pivoting. Choose the value g from an initial approximation to the eigen- 
vector x) by g = x(0)" Ax) / х(0) *x(0) ) 

The only changes in the algorithm for the power method (see page 742) are to 
set an initial value g as described (do this prior to step 1), determine у in step (4a) 
by solving the linear system (A — дГ)у = x (if the system does not have a unique 
solution, output a message that g is an eigenvalue and stop), delete step (4d), and 
replace step (4f) with 


1 
if ERR < TOL then set u = — + g, ООТРОТ(џ, x): STOP. 
ГП 
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8.2.5.4 Wielandt de ation 


Once the dominant eigenvalue has been found, remaining eigenvalues can be found 
by using de a tion techniques. A new matrix В is formed having the same eigenval- 
ues as A, except that the dominant eigenvalue of A is replaced by 0. One method is 


" d . Ty 
Wielandt de atio n which de nes x = —1 [ап ai» ... ањ]ї, where v? is a coor- 


хы i 
dinate of v“) that is non-zero, and the values {a;1, aj», ..., Gin + are the entries in the 
i” row of A. Then the matrix В = A — ,v“x has eigenvalues 0, Хо, X3,..., An 
with associated eigenvectors (V), w©), w®), ..., w0 }, where 


v) = (Aj — A )wO + А (ху wO) (8.2.4) 


for i = 2,3,...,n. The i" row of B consists entirely of zero entries and В may 
be replaced with an (n — 1) x (n — 1) matrix В” obtained by deleting the i row 
and i column of B. The power method can be applied to В” to nd its dominant 
eigenvalue and so on. 


8.2.5 HOUSEHOLDER'S METHOD 


DEFINITION 8.2.1 


Two n x n matrices А and B are said to be similar if a non-singular matrix S exists 
with A = S“! BS. (Note that if A is similar to B, then they have the same set of 
eigenvalues.) 


Householder's method constructs a symmetric tridiagonal matrix B that is sim- 
ilar to a given symmetric matrix А. After applying this method, the QR algorithm 
can be used ef ciently to approximate the eigenvalues of the resulting symmetric 
tridiagonal matrix. 


8.2.6.1 Algorithm for Householder's method 

To construct a symmetric tridiagonal matrix A ("—1) similar to the symmetric matrix 
А = AU), construct matrices AO , AG), .. , A(^-U, where AM) = (at) for k — 
1,2,...,n — 1. 


INPUT: dimension n, matrix A. 


OUTPUT: А(®-1). (At each step, A can be overwritten.) 
Algorithm: 


1. Fork =1,2,...,n — 2 do (a)-(k). 
(à) Setq = 3^ La (at. 

(b) If aj), „ = 0 then set a = —gž 

(k) / 


1, 
else set a = —q? актык 


k 
т! 
(c) Set RSO = a? — аа), p 
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(d) Setv, = 0. (Note: v4 = --- = vy 21 = 0, but are not needed.) 
8610 41 = pix — Q; 
forj = k +2,...,n set vj За 
(e) Forj —k,k +1,...,n setu; = (У uuu а ш) /RSO. 
(f) Set PROD = Ð; руу шш. 
(g) For j 2 k, k +1,...,n set z; = uj — (PROD/2 RSQ)v;. 
(h) For£—k+1,k +2,...,n — 1 do i-i. 


i For j —6+1,...,n set ш = а - VEŽj — 0326; 
ЕЭ н), 
п. Set а) = al? - 20624. 
(1) Set gt BL) = ad — 2UnZn- 
0) Forj =k+2,...,n set ap = 54 - 0. 
H1 k+1) _ (Е+1) 


k4 k 
(k) Set a = аша - Uk+12k3 пае = Antik: 
(Note: The other elements of А\#+1) are the same as AU? .) 


. OUTPUT (4("—1)). STOP. 


(A(^—U is symmetric, tridiagonal, and similar to A.) 


8.2.7 QR ALGORITHM 


The QR algorithm is generally used (instead of de ation) to determine all of the 
eigenvalues of a symmetric matrix. The matrix must be symmetric and tridiagonal. 
If necessary, rst apply Householder’s method. Suppose the matrix A has the form 


ал b» 0 дк» 0 0 0 
by аз ba 0 0 0 
0 bs аз 0 0 0 
А = 3 
0 0 0 ал—2 багл 0 
0 0 0 bs аһ-1 bn 
0 0 0... 0 by an 


(8.2.5) 


If b2 = 0 or bn = 0, then A has the eigenvalue a1 or an, respectively. If b; = 0 for 
some 7, 2 < j < n, the problem is reduced to considering the smaller matrices 


0 0 аў bi 0 0 
bs 0 b; ы Qj+1 b; 2 0 
аз 0 bj+2 аә 
апа 4 d d 
Qj—2 bia 0 0 а,-1 by 
bia aj—1 0 0 bn an 
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(8.2.6) 


If no b; equals zero, the algorithm constructs AU), AC), AG), ... as follows: 


1. A“ = A is factored as AU = QM RU, with 00) orthogonal and RU) 
upper-triangular. 


2. AO) is de ned as A?) = 6904), 
In general, 40+) = 6000 = (Q0 40)Q0 = 0914000, Each 


AGED is symmetric and tridiagonal with the same eigenvalues as A © and, hence, 
has the same eigenvalues as A. 


8.2.7.1 Algorithm for QR 


To obtain eigenvalues of the symmetric, tridiagonal n x n matrix 


a) 59 0 0 0 0 
Wo a n o 0 0 
0 59 а 0 0 0 
А= А = |: ub. 4 qM (8.2.7) 
o vir 0 aD, 590 
0 0 0 KD, aO, of 
0 0 о о MD аф 


INPUT: n; fa, s a), KD, ee oy, tolerance TOL, and 
maximum number of iterations М. 
OUTPUT: eigenvalues of A, or recommended splitting of A, 
or a message that the maximum number of iterations was exceeded. 
Algorithm: 
1. Set k = 1; SHIFT = 0. (Accumulated shift) 
2. While k < M, do steps 3-12. 
3. Test for success: 
(a) If Ш < = aS") + SHIFT; 
OUTPUT (А); set n = n — 1. 
(b) If os | < TOL then set А = aS") + SHIFT; 


OUTPUT (А); 
set n = n — 1: ад EN а; 
к=» леді =a 8! ний, 


(с) If = 0 then STOP. 
(d) If n = 1 then set A = a“) + SHIFT; 
OUTPUT(A); STOP. 
(e) For j = 3,...,n— 1 
if Ш < TOL then 
OUTPUT (“split into", fat", ...,a,, M, ... 0}, 
“ИГ ШК 50 ЖО. E SHIET): STOP. 


© 2003 by CRC Press LLC 


4. Compute shift: 
Set b = —(а®, + al); c= atf аб — ыу; d= (b? — 4e)ž. 
5. If b > 0, then set pı = —2c/(b + d); po = —(b + d)/2; 
else set uj = (d — b) /2: ро = 2e/(d — b). 
6. If n = 2, then set Ay = иу + SHIFT, А = иә + SHIFT, 
OUTPUT (ХА, А); STOP. 


(k) (k) 


= min ( Ил = an 
8. Accumulate shift: Set SHIFT = SHIFT + s. 


9. Perform shift: For j = 1,...,n set dj = а(® — s. 


j 
10. Compute RU) : 
(a) Set zı = dy; yı = бэ. 
(b) For j = 2,...,n 
set 2-1 = (27.1 + | ]?)#; су = maf 


H2 — ад) 


7. Choose s so that E —a | 


, 


k 
set s; = P /2; 120-і = сууу—1 + sid; 
set rz; = —sjyj—i + Cd. 
If j An then set rj 1 = э yj = су 0. 


k) 


(At this point, A® = p; A‘ 
matrix) and R(*) = As) 8) 
11. Compute A+), 


1 has been computed (Р, is a rotation 


(a) Set zn = £n; а = 8241 + С221; 

(b) Богу = 2,3...,n – 1, 

set a 
k 

set шэнэ = 8j+12j+1- 


(c) Set а) —u iE. 


ir = 8929. 


= $j41dj t CjCj412j; 


12. Set k = k +1. 


13. OUTPUT (*Maximum number of iterations exceeded"); 
(Procedure unsuccessful.) STOP. 
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8.2.8 NON-LINEAR SYSTEMS AND NUMERICAL OPTIMIZATION 
8.2.8.1 Newton’s method 


Many iterative methods exist for solving systems of non-linear equations. Newton 5 
method is a natural extension from solving a single equation in one variable. Con- 
vergence is generally quadratic but usually requires an initial approximation that 
is near the true solution. Assume F(x) — 0 where x is an n-dimensional vector, 
F : R” — R”, and 0 is the zero vector. That is, 
Г. 
(8.2.8) 
А х ed-point iteration is performed on G(x) = x — (J(x)) ~'F(x) where J(x) 
is the Jacobian matrix, 


F(x) = F(zi,23,...,24) = [fi (21, 22,..., 2n)... fui 22... En) 


oh (x) ёр (х) ЫГ, on (x) 
әр. б) ә (i б) у. 9 B (x) 
215355 oe си? (8.2.9) 
Әр) Әу) Of (x) 
Әлі One Orn 
The iteration is given by 
x) = G( 071) = x7 — 7) T! F(x-2), (82.10) 


The algorithm avoids calculating (J(x)) ^! at each step. Instead, it nds a vector 
y so that Л(х(7:1))у = -Е(х(5-1)), and then sets х'®) = х'®—1) + y. 

For the special case of a two-dimensional system (the equations f(x, у) = 0 and 
g(x,y) = 0 аге to be satis ed), Newton’s iteration becomes: 


79, = fyg 
En41 = In — ЕЕЕ. | 
Мау S fuga t=2n,Y=Yn 
| (8.2.11) 
is Ма- f9« 
n ý fey — fuga 


2--2т,У- Ут 


8.2.8.2 Method of steepest-descent 


The method of steepest-descent determines the local minimum for a function of the 
form g : R” — R. It can also be used to solve a system 1 f + of non-linear equations. 
The system has a solution x = (21, £2,..., £n)” when the function 
n 
g(zi,22,...,24) = У (аз, 23. ӨМ E (8.2.12) 
і-і 
has the minimal value zero. 

This method converges only linearly to the solution but it usually converges 
even for poor initial approximations. It can be used to locate initial approximations 
that are close enough so that Newton’s method will converge. Intuitively, a local 
minimum for a function g : IR" — R can be found as follows: 
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1. Evaluate g at an initial approximation x) = (9, cis жүт, 

2. Determine а direction from x) that results in a decrease in the value of g. 
3. Move an appropriate distance in this direction and call the new vector x а), 
4. Repeat steps 1 through 3 with x“) replaced by xU. 


The direction of greatest decrease in the value of g at x is the direction given by 
—V g(x) where V g(x) is the gradient of g. 


DEFINITION 8.2.2 


If g : R^ > R, the gradient of g atx = (£1, %2,...,%n)", denoted V g(x), is 


Vg(x) = (Zo LLE 99 e) ; (8.2.13) 


Әлі” Әле ^ ^ Әт 


Thus, set x = x0) — a Vg(x(9) for some constant a > 0. Ideally the value 
of a minimizes the function h(a) = g (x) — aVg(x(9)). Instead of tedious di- 
rect calculation, the method interpolates /; with a quadratic polynomial using nodes 
01, Q2, and оз that are hopefully close to the minimum value of В. 


8.2.8.3 Algorithm for steepest-descent 
To approximate a solution to the minimization problem шин g(x), given an initial 
хе 


approximation x. 


INPUT: number n of variables, initial approximation x = (£1, £2,..., £n)", 
tolerance TOL, and maximum number of iterations Л. 
OUTPUT: approximate solution x = (21,29,...,т,)! 
or a message of failure. 
Algorithm: 
І. Set k = 1. 


2. While (k < А), do steps (a)-(k). 


(a) Set: 01 = g(z1,..., £n); (Note: gı = g(x)).) 
Z = Vg(zi,..., £n); (Note: z = Vg(x(?)).) 
20 = |14113. 
(b) If zo = O then OUTPUT (“Zero gradient“): 
OUTPUT (21,...,2,,41); 
(Procedure completed, may have a minimum.) STOP. 
(c) Set z = z/zo. (Make z a unit vector.) 
Set ay = 0; аз = 1: ga = g(x — аз2). 
(d) While (уз > 91), do steps i-ii. 
i. Set a3 = 03/2; 03 = g(x — 032). 
ii. If o3 < TOL/2, then 
OUTPUT (“No likely improvement"); 
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OUTPUT (21,...,2n,91)3 
(Procedure completed, may have a minimum.) 
STOP. 


(е) Set ag = 03/2; go = g(x — a27). 
(f) Set: hi = (ga — 91) /02; һә = (9з — 92)/(оз- a2), 
ha — (һә 22 hi)/as. 
(g) Set: ag = (az — hi/ha)/2 (critical point occurs at ag.) 
до = g(x — aoz). 
(h) Find a from fag, a3} so that g = g(x — az) = min{go, 93}. 
(1) Set x = x — oz. 
@ If |g — gi| < TOL then OUTPUT (1,...,2n.9): 
(Procedure completed successfully.) STOP. 
(k) Setk — k +1. 


3. OUTPUT (“Maximum iterations exceeded"); 
(Procedure unsuccessful.) STOP. 


8.3 NUMERICAL INTEGRATION AND 
DIFFERENTIATION 


8.3.1 NUMERICAL INTEGRATION 


Numerical quadrature involves estimating f J (x) dx using a formula of the form 


b n 
| f(x) dz eN af(zi). (8.3.1) 
Ё i=0 
8.3.1.1 Newton-Cotes formulae 
A closed Newton-Cotes formula uses nodes x; = xo + ih fori = 0,1,...,n, where 
h = (b — a)/n. Note that zo = a and x, = b. 
An open Newton—Cotes formula uses nodes r, = zo + ih fori = 0,1,...,n, 


where h = (b — a)/(n + 2). Here zo = a + hand rn = b — h. Set | = a and 
ďn+1 = b. The nodes actually used lie in the open interval (a, b). 
In all formulae, 6 is a number for which a < € < b and f; denotes /(т;). 


8.3.1.2 Closed Newton- Cotes formulae 
1. (n = 1) Trapezoidal rule 


b 3 
[ fs = Ка) f) - BO: 
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2. (n = 2) Simpson’s rule 
Ге) f) de = қа) аҚа) 4191-1191), 
3. (n = 3) Simpson’s three-eighths rule 
| а) = Pe fero) + 3/(а1) + 3f a2) + f(a3)] - arg (9. 
4. (n = 4) Milne’s rule (also called Boole’s rule) 


г аж т +32), + 12f; + 32f3 +74] — "a (е). 


5. (n = 5) 


h 
07 = ЭЁ портал + зол +зол тоол] 2n е) 


6. (п = 6) Weddle’s rule 


b 
| f(a) dr = = 2011/0 +216] +27 fo +272 fs +274 +2165 +41 fe] 


b 
| Ке ) de = [751 fo 3577 fi +1323 fy 2080 f+ 2989 fy +1323 fs 
a 


8183h9 


+35776 + 1751 fil — “102009 


8.3.1.3 Open Newton-Cotes formulae 
1. (n = 0) Midpoint гше 


b 13 
] (dco ва) + EO 


3 
+ ч 


b 
| f do = ув) + fa] + 
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b 5 
| tode ру) — Fler) «эг + FEL. 


4. (п- 8) 
M Ка de = ČMS) + f(z1) + Қаз) 11f(13)] + El ЛЭ) 
fe fa de = ЭЁ мл +26 — 14}, + 1171] + EE FO g). 
6. (n = 5) 


b 
! f(a) dr = бил — 453 f. + 562 fo 4-562/5-453/4-6115| 


7 
5257h" Т ). 
8640 


8.3.1.4 Composite rules 


Some Newton-Cotes formulae extend to composite formulae. This consists of divid- 
ing the interval into subintervals and using Newton-Cotes formulae on each subin- 
terval. In the following, note that a < u < b. 


1. Composite trapezoidal rule for n subintervals: If f € C?[a,b],h = (b — a)/n, 
and x; = a + jh, for j = 0,1,...,n, then 


um вээ ге) j+ 40) - 52 


2. Composite Simpson’s rule for n subintervals: If f € Са, b], n is even, h = 
(b — a)/n, anda; = a + jh, for j = 0,1,..., n, then 


f" (и). 


oe n/2 
[seu a) +2 у Каз) + AM | Каз-а) + SO) 
7-1 j=l 
b—a 
Eum (4) 
180: 57.09. 


3. Composite midpoint rule for n + 2 subintervals: If f € C?[a,b],n is even, 
h = (b—a)/(n--2), and z; = a+ (j+ 1)h, for j = —1,0,1,...,1 +1, then 


n/2 


[ғ келше 


T 
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8.3.1.5 Romberg integration 

Romberg integration uses the composite trapezoidal rule beginning with hy = b — 
a and hy = (b — a)/2*-!, fork = 1,2,..., to give preliminary estimates for 
f? f(x)dx and improves these estimates using Richardson’s extrapolation. Since 
many function evaluations would be repeated, the rst column of the extrapolation 
table (with entries denoted R; j) can be more ef ciently determined by the following 
recursion formula: 


Raa = уа) 4 £0) = HE + £0] 
1 | gee | (8.3.2) 
Rea = 2 ші + А-1 2 Қа-(24- “| : 


for k = 2,3,.... Now apply Equation (8.1.4) to complete the extrapolation table. 


8.3.1.6 Gregory s formula 
Using f; to represent f (to + jh), 


to+tnh 1 1 
[fa = Moe fit fat go) 


20 


h h 
+ 15 ОЛ cA em (№ + A? fr—2) 


19h 3h 
+ ŠA? fo — жу 


= 160.2 fot Af. a)... (833) 


where A's represent forward differences. The rst expression on the right in Equa- 
tion (8.3.3) is the composite trapezoidal rule, and additional terms provide improved 
approximations. Care must be taken not to carry this process too far because Gre- 
gory's formula is only asymptotically convergent in general and round-off error can 
be signi cant when computing higher differences. 
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FIGURE 8.2 


Formulae for integration rules with various weight functions 
Weight Interval Abcissas 
w(x) (a, 8) are zeros of Wi Kn 
229 |O29U(n) JR 
See tabl 755 
үне a ии (n +1)Р„+1(х;)РЬ(т;) (2n + 1) 2n)? 
ое е EAN ре EE la 
! 
=. —1)т 
—1,1) 


1 22 — 12 1,1 —— 
жыры | TES! ТЕЗІ PrE 
(0, 1) Ton ( изу) (2i — 1)т (2i — 1)7 T 
Ant? "m + i “dn +2 24141 (25)! 
т 
(0,1) n 
ү 2n +1 I PEE 22n (2n)! е 


T " гали 9n Ур 
4n + 1)[(4n)!]? 


(0,1) Pants (ve) 27"? 20417806 2n + 1)1]* 
4n + 3)[(4n + 2)!? (2n)! 


In this table, Pa, Ln, Hn, Tr, Un, and Jn denote the n'^ Legendre, нее Hermite, Chebyshev (rst kind 75, second 


kind Г/,), and Jacobi polynomials, respectively. Also, 2+ dene the 1" positive root of P», (х) or Pon +1 (x) of the 
previous column, and h, denotes the corresponding weight for xr in the Gauss-Legendre formula (w(x) = 1). 
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8.3.1.7 Gaussian quadrature 


A quadrature formula, whose nodes (abscissae) x; and coef cients w; are chosen 
to achieve a maximum order of accuracy, is called a Gaussian quadrature formula. 
The integrand usually involves a weight function w. An integral in ¢ on an interval 
(a,b) must be converted into an integral in x over the interval (a, 8) speci ed for 
the weight function involved. This can be accomplished by the transformation 2 = 


ботай! + +. Gaussian quadrature formulae generally take the form 


(8.3.4) 


8 
| w(0) f(@) de = Vw) + Es 


a 


where En = Kn f (E) for some a < € < 8 and K, is a speci ed constant. Many 
popular weight functions and their associated intervals are summarized in the table 
on page 754. 

The following tables give abscissae and weights for selected formulae. If some 
тү, are speci ed (such as one or both end points), then the formulae of Radau and 
Lobatto may be used. 


8.3.1.8 Gauss—Legendre quadrature 


Weight function is w(x) = 1. 


| | f(z) de м 217 


ЕЗ Nodes {+2;} | Weights {ш;} ЕШ Nodes {+2;} | Weights {w;} 


0.5773502692 


0 
0.7745966692 


0.3399810436 
0.8611363116 


0 
0.5384693101 
0.9061798459 


0.2386191861 
0.6612093865 
0.9324695142 


0 

0.4058451514 
0.7415311856 
0.9491079123 
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1 


0.8888888889 
0.5555555556 


0.6521451549 
0.3473543451 


0. 56838883839 
0.4786286705 
0.2369268851 


0.4679139346 
0.3607615730 
0.1713244924 


0.4179591837 
0.3818300505 
0.2797053915 
0.1294849662 


0.1834346425 
0.5255324099 
0.7966664774 
0.9602898565 


0 

0.3242534234 
0.6133714327 
0.8360311073 
0.9681602395 


0.1488743390 
0.4333953941 
0.6794095683 
0.8650633667 
0.9739065285 


0.3626837834 
0.3137066459 
0.2223810345 
0.1012285363 


0.3302393550 
0.3123470770 
0.2606106964 
0.1806481607 
0.0812743883 


0.2955242247 
0.2692667193 
0.2190863625 
0.1494513492 
0.0666713443 


8.3.1.9 Gauss—Laguerre quadrature 


Weight function is w(x) = e^*. 


E Yu 2) 


Ln T Nede {ш} [ Weighs ps] [n [Nodes pr] [ Weights Гал 


0. Id 
3.4142135623 


0.4157745567 
2.2942803602 
6.2899450829 


0.3225476896 


1.7457611011 
4.5366202969 
9.3950709123 


0.2635603197 
1.4134030591 
3.5964257710 
7.0858100058 
12.6408008442 


0.8535533905 
0.1464466094 


0.7110930099 
0.2785177335 
0.0103892565 


0.6031541043 
0.3574186924 
0.0388879085 
0.0005392947 


0.5217556105 
0.3986668110 
0.0759424496 
0.0036117586 
0.0000233699 


0. Sd 
1.1889321016 
2.9927363260 
5.7751435691 
9.8374674183 
15.9828739806 


0.1930436765 
1.0266648953 
2.9678767449 
4.9003530845 
8.1821534445 
12.7341802917 
19.3957218622 


0.4589646739 
0.4170008307 
0.1133733820 
0.0103991974 
0.0002610172 
0.0000008985 


0.4093189517 
0.4218312778 
0.1471263486 
0.0206335144 
0.0010740101 
0.0000158654 
0.0000000317 


8.3.1.10 Gauss—Hermite guadrature 


00 n 
Weight function is w(x) = e77. | e * fa) ах ғ 5 wif (zi). 
9S i=1 


Ей Nodes 13:26) | Weights fw; 


0.7071067811 


0 
1.2247448713 


0.5246476232 
1.6506801238 


0 
0.9585724646 
2.0201828704 


0.4360774119 
1.3358490740 
2.3506049736 
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0.3862269254 


1.1316359006 
0.2954089751 


0.3049140900 
0.0813128354 


0.9453087204 
0.3936193231 
0.0199532420) 


0.7246295952 
0.1570673203 
0.0045300099 


Е 
1.6735516287 
2.6519613568 


0.3811869902 
1.1571937124 
1.9816567566 
2.9306374202 


0 

0.7235510187 
1.4685532892 
2.2665805845 
3.1909932017 


0.8102646175 
0.4256072526 
0.0545155828 
0.0009717812 


0.6611470125 
0.2078023258 
0.0170779830 
0.0001996040 


0.7202352156 
0.4326515590 
0.0884745273 
0.0049436242 
0.0000396069 


8.3.1.11 Radau шин, 


[ro ТЭРЭГ? сав nin - 004 


23 БЭ (>) + Tan — туа 


where each free node т; is the 27 root of urbe 


i-2,... 


n — Nes [Weights qu] 


pe gy 


and ш; = Р, for 


әт; see the following table. Note that лу = —1 and w1 = 2/n?. 


БІЛ [Noses [Weighs fu) 


—0.2898979485 
0.6898979485 


—0.5753189235 
0.1810662711 
0.8228240809 


—0.7204802713 
—0.1671808647 
0.4463139727 
0.8857916077 


-0.8029298284 
-0.8909285467 
0.1240503795 
0.6039731642 
0.9203802858 


—0.8538913426 
—0.5384677240 
—0.1173430375 
0.3260306194 
0.7038428006 
0.9413671456 


1.0249716523 
0.7528061254 


0.6576886399 
0.7763869376 
0.4409244223 


0.4462078021 
0.6236530459 
0.5627120302 
0.2874271215 


0.3196407532 
0.4853871884 
0.5209267831 
0.4169013343 
0.2015883852 


0.2392274892 
0.3809498736 
0.4471098290 
0.4247037790 
0.3182042314 
0.1489884711 


8.3.1.12 Lobatto guadrature 


—0.8874748789 
—0.6395186165 
—0.2947505657 
0.0943072526 
0.4684203544 
0.7706418936 
0.9550412271 


—0.9107320894 
—0.7112674859 
—0.4263504857 
—0.0903733696 
0.2561356708 
0.5713830412 
0.8173527842 
0.9644401697 


—0.9274843742 
—0.7638420424 
—0.5256460303 
—0.2362344693 
0.0760591978 
0.3806648401 
0.6477666876 
0.3512252205 
0.9711751807 


0.1853581548 
0.3041306206 
0.3765175453 
0.3915721674 
0.3470147956 
0.2496479013 
0.1145088147 


0.1476540190 
0.2471893782 
0.3168437756 
0.3482730027 
0.3376939669 
0.2863866963 
0.2005532980 
0.0907145049 


0.1202966705 
0.2042701318 
0.2681948378 
0.3058592877 
0.3135824572 
0.2906101648 
0.2391934317 
0.1643760127 
0.0736170054 


| ПОЛО 


-1 
n—1 
+ 2, wif (xi) — 
where x; is the (i — 1)“ root of P; ,(r) and w; = ШЕЕ 10308 fori = 
2,...,n — 1. Note that zı = —1, £n = 1, and wj = Wn = 2/(n(n — 1)). The table 


lists all z; and 10, form < 13. 


n(n — 1)?2?"-1[(m — 2)!]4 


(а Den- DE 7 (2n—2) (£) 
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| 


0.4472135954 
1 


0 
0.6546536707 
1 


0.2852315164 
0.7650553239 
1 


0 
0.4688487934 
0.8302238962 
1 


0.2092992179 
0.5917001814 
0.8717401485 
1 


0 
0.3631174638 
0.6771862795 
0.8997579954 
1 


Nodes {+2} 


2 | 0.5773502691 


za Nodes 1-24) | Weights {ш;} 


1.3333333333 
0.3333333333 


0.3333333333 
0.1666666666 


0.7111111111 
0. 5444444444 
0.1000000000 


0.5548583770 
0.3784749562 
0.0666666666 


0.4876190476 
0.4317453812 
0.2768260473 
0.0476190476 


0.4124587946 
0.3411226924 
0.2107042271 
0.0357142857 


0.3715192743 
0.3464285109 
0.2745387125 
0.1654953615 
0.0277777777 


8.3.1.13 Chebyshev quadrature 


0.4779249498 
0.7387738651 
0.9195339081 


0.2957581355 
0.5652353269 
0.7844834736 
0.9340014304 
1 


12 | 0.1365529328 


0.3995309409 
0.6328761530 
0.8192793216 
0.9448992722 


0.2492869301 
0.4829098210 
0.6861884690 
0.8463475646 
0.9533098466 
1 


ІШКЕ da ғ ЭЭ) 


Nodes {®2;} 
510 


Nodes {+2;} | Weights {ш;} 


10 | 0.1652789576 


0.3275397611 
0.2920426836 
0.2248893420 
0.1333059908 
0.0222222222 


0.3002175954 
0.2868791247 
0.2480481042 
0.1871698817 
0.1096122732 
0.0181818181 


0.2714052409 
0.2512756031 
0.2125084177 
0.1579747055 
0.0916845174 
0.0151515151 


0.2519308493 
0.2440157903 
0.2207677935 
0.1836468652 
0.1349819266 
0.0778016867 
0.0128205128 


Nodes (+111 
710 


0.3745414095 
0.8324974870 


0.3239118105 
0.5296567752 


0.7071067811 0.8838617007 
0.2666354015 
0.4225186537 


0.8662468181 


4 | 0.1875924740 
0.7946544722 
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8.3.1.14 Multiple integrals 


Ouadrature methods can be extended to multiple integrals. The general idea, using 
a double integral as an example, involves writing the double integral in the form of 
an iterated integral, applying the quadrature method to the “inner integral” and then 
applying the method to the “outer integral". 


8.3.1.15 Simpson's double integral over a rectangle 


To integrate a function f(x, y) over the rectangular region R = ((z,y) |a < x € 
b,c € y < d using the composite Simpson's Rule produces an approximating 
formula given below. Intervals [a, b] and [c, d] must be partitioned using even integers 


n and m to identify evenly-spaced mesh points z9,21,..., £n and yo, yi,.... Um: 
respectively. 
h n m 
f [ reae | f tenai- > dns Gi) )+E 
ч i=0 j—0 
(8.3.5) 
where the error term F is given by 
ud sve (ba) үл РТИ 
E-—-——55-5—— |} k“ = 8.3.6 
180 aya Un B) + oy UNT (8.3.6) 


7 some (7, ji) and (7), Ô) in R with h and k determined by h = (b — a)/n and 
= (d — c) /m, and the coef cients c, are the entries in the following table. 


Similarly, Simpson’s Rule can be extended for regions that are not rectangular. 
It is simpler to give the following algorithm than to state a general formula. 


8.3.1.16 Simpson’s double integral algorithm 


iu 
To approximate the integral / — [ [of (x, y) dy da: 


INPUT endpoints а, b: even positive integers m, n; 
functions с(т), d(x), and f (x, у) 
OUTPUT approximation J to 1. 
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Algorithm: 
1. Seth = (b — a)/n; Jı = 0; (End terms.) 
Jz = 0; (Even terms.) J3 = 0. (Odd terms.) 
2. Fori = 0,1, ...,n do (a)-(d). 


(a) Setz = а + ih; 
(Composite Simpson’s method for x.) 
HX = (d(x) — c(x))/m; 
Kı = f(x,c(x)) + f(a, d(x)); (End terms.) 
Kə = 0; (Even terms.) 
Кз = 0. (Odd terms.) 
(b) For j = 1,2,...,m — 1 do i-i. 
i. Sety = z) + JHX, О = f(x,y). 
ii. If j is even then set Ky = Kə + Q else set Кз = K3+Q. 


(c) Set L = (Kı +2K +4K3)HX/3. 


d(zi) 
(L Ri 1 f (xi, y) dy by composite Simpson’s method. ) 
с(аы) 
(d) Ifi = 0 ori = n then set Jj = J + L; 
else if i is even then set Jo = Jo + L; 
else set J3 = J3 + L. 


3. Set J = Һ(Л + 2.» + 4J3)/3. 
4. OUTPUT(J); 
STOP. 


8.3.1.17 Gaussian double integral 
d(x 


b ) 
To apply Gaussian quadrature to 7 = f | f(x,y) dy dx rst requires trans- 
a Jele) 


forming, for each x in [a,b], the interval [c(x), d(z)] to [—1, 1] and then applying 
Gaussian quadrature. This is performed in the following algorithm. 


8.3.1.18 Gauss—Legendre double integral 
b Р(х) 
To approximate the integral I = | | f(a, у) dy ах: 
a 4с(2) 


INPUT endpoints a, b; positive integers m, n. 
(The roots r; ; and coef cien ts c, j are found in 8.3.1.8 for 
i = max(m,n) and for 1 € j € i.) 
OUTPUT approximation J to [. 
Algorithm: 
1. Seth; = (b — a)/2; ho = (b + a)/2; 7-0. 
2. Fori = 1,2, ...,m do (а)—(с). 
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(a) Set JX =0; 

т = hitmi + Ро; 

di = d(x); е = dr), 

ky = (di = с1)/2: ko = (di + c1)/2. 
(b) For j = 1,2,...,n do 

set y — Кта, + ko; 

Q = f(x,y); 

JX = JX + en jQ. 
(c) Set J = J + eg iki JX. 


3. Set = hy J. 
4. OUTPUT(J); STOP. 


8.3.1.19 Double integrals of polynomials over polygons 
If the vertices of the polygon A are { (21,11), (22,92)... - , (Cp, yp)], and we de ne 
Wi = т ал — 710 (With zy 4,1 = z1 and yp41 = Y1) then 


| f ay" dA = (8.3.7) 


т\т! г ш 25 m+n—j—k moj ný k 
mR LY Ly a: apel ayr “йн: 


= j=0 k—0 


8.3.1.20 Monte-Carlo methods 


Monte-Carlo methods, in general, involve the generation of random numbers (ас- 
tually pseudorandom when computer-generated) to represent independent, uniform 
random variables over [0, 1]. Section 7.6 describes random number generation. Such 
a simulation can provide insight into the solutions of very complex problems. 
Monte-Carlo methods are generally not competitive with other numerical meth- 
ods of this section. However, if the function fails to have continuous derivatives 
of moderate order, those methods may not be applicable. One advantage of Monte- 
Carlo methods is that they extend to multidimensional integrals quite easily, although 


here only a few techniques for one-dimensional integrals Г = f 1 g(a) dx are given. 


8.3.1.21 Hit or miss method 


Suppose 0 < g(x) < ca < v < b, and Q = ((z,y) az < 6,0 < y< c}. If 
(X, Y) is a random vector which is uniformly distributed over Q, then the probability 
p that (X,Y) lies in S (see Figure 8.3) is p = 1/(с cb — a)). 

If N independent random vectors ((X ;, Y;) }_, are generated, the parameter р 
can be estimated by p = Nr /N where Ny is the number of times Y; < g(X;), i = 
1,2,..., N, called the number of hits. (Likewise N — N р is the number of misses.) 
The value of 7 is then estimated by the unbiased estimator 91 = c(b — a) Ng /N. 
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FIGURE 8.3 


Illustration of the Monte-Carlo method. The sample points are shown as circles. The solid 
circle is counted as a "hit", the empty circle is counted as a "miss". 


8.3.1.22 Hit or miss algorithm 


1. Generate {U;}5%, of 2N random numbers, uniformly distributed іп [0, 1). 

2. Arrange the sequence into N pairs (U1,U1), (U>, U3), ..., (Un, UN), so that 
each U; is used exactly once. 

. Compute X; = a + U;(b — a) and g(X;) fori = 1,2,.. 

. Count the number of cases N н for which g(X;) > cU;. 

5. Compute 9, = c(b — a) Ng /N . (This is an estimate of T.) 


(95) 


М. 


>3 


AR 


The number of trials № necessary for P(|Ü; — I| < є) > a is given by 


y > 02000 – а)? 


> ae (8.3.8) 


With the usual notation of 2, for the value of the standard normal random vari- 
able Z for which P(Z > za) = a (see page 695), a con d ence interval for Г with 
con de nce level 1 — a is 


PC — p)(b — а)с 
JN 


9, + za (8.3.9) 


8.3.1.23 Sample-mean Monte-Carlo method 


Write the integral I — ru g(x) dz as |, : far x (x) ат, where f is any probability 


density function for which fx (2) > 0 when g(x) Z 0. Then] = E | —— 
where the random variable X is distributed according to f х (2). Values from this 
distribution can be generated by the methods discussed in Section 7.6.2. For the case 
where f x (x) is the uniform distribution on [0, 1], 7 = (b — a)E[g(.X )]. An unbiased 
estimator of / is its sample mean 


1 
92 = (b а) XXi. (8.3.10) 
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It follows that the variance of 02 is less than or equal to the variance of 91. In 
fact, 


var 0, = Lt — a) — I], 


b 
var 0» -1 221 g^ (a) i-r | 


Note that to estimate I with 01 or 05, g(x) is not needed explicitly. It is only 
necessary to evaluate g(x) at any point z. 


(8.3.11) 


8.3.1.24 Sample-mean algorithm 
1. Generate {U;}_, of N random numbers, uniformly distributed in (0, 1). 
2. Compute X; = a + U,(b — a), fori = 1,2,..., N. 
3. Compute g( X1) fori = 1,2,..., N. 
4. Compute 05 according to Equation (8.3.10). (This is an estimate of Т.) 


8.3.1.25 Integration in the presence of noise 

Suppose g(a) is measured with some error: 0(2:) = 9(2;) + ei, for i = 1,2,..., N, 
where е; are independent identically distributed random variables with E[e;] = 0, 
var(e;) = 07, and |e;| < k < oo. 

If (X,Y) is uniformly distributed on the rectangle a < z < b,0 < y < ci, 
where сі > glx ) t k, set 6, = ci(b — а)Ун/У as in the hit or miss method. 
Similarly, set 6; = x (b—a) xu 1 g(X;) as in the sample-mean method. Then both 
6, and 0; are unbiased and converge almost surely to Г. Again, var 05 < var 01. 


8.3.1.26 Weighted Monte-Carlo integration 
Estimate the integral 7 = fog o g(x) dx according to the following algorithm: 
1. Generate numbers 1, Us, . .. „Un + from the uniform distribution on (0, 1). 
2. Arrange U1, U2,..., Un in the increasing order Vay, Хо). ын Шох). 
N 


1 
3. Compute 0з = 2 X Uo) + HU) (ан) = Uc) |, where Uo) = 


i=0 
0, U(v41) = 1. This is an estimate of Г. 


If g(x) has a continuous second derivative on [0, 1], then the estimator Өз satis- 
es var 63 = E [(0з — I)?] < k/ N^, where k is some positive constant. 
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8.3.2 NUMERICAL DIFFERENTIATION 


8.3.2.1 Derivative estimates 

Selected formulae to estimate the derivative of a function at a single point, with error 
terms, are given. Nodes are equally spaced with x; — 2-1 = h; h may be positive 
or negative and, in the error formulae, € lies between the smallest and largest nodes. 
To shorten some of the formulae, f; is used to denote /(то + jh) and some error 
formulae are expressed as O(h*). 


1. Two-point formula for f (ғо) 


(fas +h) Л) ВО. 8342) 


ale 


f (20) = 


This is called the forward-difference formula 1f h > 0 and the backward- 
difference formula if h < 0. 


2. Three-point formulae for f (ло) 


2 
Р (ко) = ЕТЕ + Af (zo + h) — f(xo + 2h)] + go (£) 
(8.3.13) 


= Zle d) fn ess K нө (8). 


3. Four-point formula (or ve uniformly spaced points) for f ' (zo) 


4 
Гао) = alt —8f 1+ 8f1 — fo] + TOD. (8.3.14) 


4. Five-point formula for f'(xo) 


f (zo) = 7 [-25fo + 48f1 — 36 fo + 16 f3 — 3f4] + go (£). (8.3.15) 


B 


5. Formulae for the second derivative 


п 1 h? (4) 
f (20) = za- — 2fo + fi] — 137 (8) 


1 * (8.3.16) 
a Fal ZÁ + hl + FR) — A19 (6). 
6. Formulae for the third derivative 
FO (a9) = р Fle- 3h +3 — fo] + Oh) 
(8.3.17) 


— sl — 2f1 +2f-1— f-2] + O(h’). 
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7. Formulae for the fourth derivative 


f?) = у АА + 6/2 —4/ + fol + O(h) 
1 (8.3.18) 
= Їз —АЛ +6о —4f-1 + f-2] + O(h’). 


Richardson’s extrapolation can be applied to improve estimates. The error term 
of the formula must satisfy Equation (8.1.2) and an extrapolation procedure must be 
developed. As a special case, however, Equation (8.1.4) may be used when rst- 
column entries are generated by Equation (8.3.13). 


8.3.2.2 Computational molecules 


A computational molecule is a graphical depiction of an approximate partial deriva- 
tive formula. The following computational molecules are for h = Ax = Ay: 


dul | 1 7 Е 7 
o Qn се u-1,0)+ О (А?) -510- 00-0 () 
dul 1 : qu | 
Lc сэн uoi) +0 (7) = gx (0), ; +0 (n?) 
Bu 1 Я 
(с) Өл? А = 72 (и1,0 — 2u0,0 + ui) +0 (h ) 
OREO 
_ Ж 
0?u 1 
Ф Ox ду |, TAR (ил — W1,—1 — U11 + ua.) +0 (h°) 
1 
“ам O (h°) 
1 
(e) V^u|, = zz био + иол + U-1.0 + Uo, —1 — 4000) + О (А?) 


© 
шы жоя (te) 
Ө 


© 2003 Ьу СКС Press LLC 


8.3.2.3 Numerical solution of differential equations 


Numerical methods to solve differential equations depend on whether small changes 
in the statement of the problem cause small changes in the solution. 


DEFINITION 8.3.1 


The initial-value problem, 


dy > 
dt > 
is said to be well posed if 


f(Ly. a<t<b, vla) za, (8.3.19) 


1. A unique solution, y(t), to the problem exists. 

2. For any є > 0, there exists a positive constant К(є) with the property that, 
whenever |eo| < є and ó(t) is continuous with |ó(t)| < € on [a,b], a unique 
solution, z(t), to the problem, 

dz 


= 162) +90), a<t<b, zla) = а +60, 


exists and sais es |z(t) — y(t)| < (е) є, for all a < t < b. 


This is called the perturbed problem associated with the original problem. Al- 
though other criteria exist, the following result gives conditions that are easy to check 
to guarantee that a problem is well posed. 


THEOREM 8.3.1 (Well posed condition) 


Suppose that f and fy (its r st partial derivative with respect to y) are continuous for 
t in [a,b]. Then the initial-value problem given by Equation (8.3.19) is well posed. 


Using Taylor’s theorem, numerical methods for solving the well posed, rst- 
order differential equation given by Equation (8.3.19) can be derived. Using equally- 
spaced mesh points t; = a + ih (fori = 0,1,2,..., №) and w; to denote an approx- 
imation to y; = y(t;), then methods generally use difference equations of the form 


Wo = о, 40:41 = Wi + ho(ti, wa), 


for each т = 0,1,2,..., N — 1. Here © is a function depending on f. The difference 
method has local truncation error given by 


Ti41(h) = шир чин — é(ti, yi), 


for each 4 = 0,1,2,..., N — 1. The following formulae are called Taylor methods. 
Each has local truncation error 

h^ pl) h^ өз) 
for each i = 0,1,2,..., № — 1, where €, € (ti, ti+1). Thus, if y € C"+![a, b] the 
local truncation error is O(h”). 
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1. Euler’s method (n = 1): 
Witt = W + hf (ti, wi). (8.3.20) 
2. Taylor method of order n: 
wizi = wi + ВТО) (t, wi), (8.3.21) 
where TV» (t,, wi) = f (ti, wi) + E f (ti, wi) +... + Be FOV (ti, wi). 


The Runge-Kutta methods below are derived from the n degree Taylor poly- 
nomial in two variables. 


3. Midpoint method: 
шып = wi +h [f (t; + $, wi + Sf (ti, wi))]. (8.3.22) 


If all second-order partial derivatives of f are bounded, this method has local 
truncation error O(h?), as do the following two methods. 


4. Modi ed Euler method: 
wisi = wi + {f (tiwi) + f[tisi wi + hf(t;;wi)]). (8.323) 


5. Heun's method: 


h 2 2 
Witt = W; + A (ыш) + 3f [ + 3^ Wi + ШТ | : 


6. Runge-Kutta method of order four: 
1 
Wizi = Wi + gh + 2k» + 283 + ka), (8.3.24) 


where 
ky = hf (ti, Wi) : 
h 1 
ko = hf (s + a wi + j^) Д 
h 1 
k3 =hf (s + уш + зе) : 
ka = hf (8-1,4) + Ёз) 5 


The local truncation error is O(h*) if the solution y(t) has ve continuous 
derivatives. 


8.3.2.4 Multistep methods and predictor-corrector methods 

A multistep method is a technique whose difference equation to compute w ,..1 in- 
volves more prior values than just w;. An explicit method is one in which the com- 
putation of ш; р: does not depend on f(t;41,wi4+1) whereas an implicit method does 
involve f(t;41,Wi41). For each formula, i = n — 1,n,..., N — 1. 
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8.3.2.5 Adams-Bashforth n-step (explicit) methods 
1. (n=2): 
шо = а, Ш = Q1, Wi = W + 413 f (ti, wi) — f(ti-1, wi-1)). 
Local truncation error is T:41(h) = &y 9) (uj) I2, for some p; € (ti a, tiui). 
2. (п = 3): 
шо = a, wi = 01, W2 = 03, Wigi = wit 2,23 (ti, wi) -16f (ti 3, wi—1)+ 
5f (tj 2, wi-2)). 
Local truncation error is 7;44 (A) = 2y (u;)h?, for some u; € (сэ, Ё). 
3. (n = 4): 
Wo = а, Шу = 01, Шә = Оз, W3 = оз, Wizi = wi + d [55f (ti, wi) — 
59 f (t1, wi-1) + 37 f (ti-2,wi-2) — 9f (ti—3, wi-s)]. 


Local truncation error is 7; , (А) = 22539) (uj) h^, for some ш; € (t; 3, +1). 
4. (n = 5): 
Wo = 0, Ш = 014, W2 = 02, Шз = Q3, W4 = 04, Witt = Wi + 


25011901 f (ti, wi) = 2774 f (ti —1,W1-1) + 2616f (ti—2, иңә) 
— 1274} (t3, W 3) + 251f (tia, wi-4)]. 


Local truncation error is тирі (h) = 3 y(9 (uj) 5, for some p; € (ti 4, tiii). 


8.3.2.6 Adams-Moulton n-step (implicit) methods 
1. (n — 9): 
wo = a, w1 = 1, Wig = wit BSS (tiga, Wig) 87 (ti, ш) f(tizi wizi)]. 
Local truncation error is трт (h) = — 4y ® (ui) ?, for some p; € (ti -1.ti+1). 
2. (n = 3): 
Wo = Q, W1 = Q1, W2 = 05, Wi41 = Wi + 2- [0 f (titi, Wi) T 19f (ti, wi) = 
Sf (ti-1, wi-1) + f(ti-a,wi-3)]. 
Local truncation error is Tr; „1 (h) = — dy) (u;)h^, 
for some u; € (tj 5, ti41). 
3. (n — 4): 
Wo = Q, W1 = Q1, W2 = 03, Шз = Q3, Witi = Wit zi [251f(tii1, wisi) + 
646 f (t;, wi) — 264 f (t; 1, Wi—1) + 106/(їс-э, иңә) = 19f (tis, а-а) 
Local truncation error is 7:41 (В) = — Boy (u) hž, 
for some џ; € (ti 3,ti11). 


In practice, implicit methods are not used by themselves. They are used to 
improve approximations obtained by explicit methods. An explicit method predicts 
an approximation and the implicit method corrects this prediction. The combination 
is called a predictor-corrector method. For example, the Adams—Bashforth method 
with n = 4 might be used with the Adams—Moulton method with n = 3 since both 
have comparable errors. Initial values may be computed, say, by the Runge-Kutta 
method of order four, Equation (8.3.24). 
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8.3.2.7 Higher-order differential eguations and systems 


A system of m rst-ord er initial-value problems сап be expressed in the form 


du 
Gr T Ооа), ui(a) = ол, 
% 
аш 
Gr = muss un); иә(а) = ав, 
t (8.3.25) 
dum 
w Tmt U1, U2,.--,;Um), шта) = Am. 


Generalizations of methods for solving rst-order equations can be used to solve 
such systems. An example here uses the Runge-Kutta method of order four. 
Partition [a,b] as before, and let w; , denote the approximation to u;(t;) for 


j = 0,1,...,N andi = 1,2,...,m. For the initial conditions, set 010 = a1, 
шәф = Q2, ..., Што = Am. From the values {w1 j, Шә,),..., Wm,j } previously 
computed, obtain {wi j+1, W2,j41,---,Wm,j+1} from 

kr = hfi (tj wi, W2,5,---5Wm,j)s 


h 1 1 1 
ko = hf; (6 + g Vij + FELD wj + 351.2, emu + stim) Р 


2 
Ёла = hfi (tj +h, wig + kaa шә) + Ёзә,...,Ш Tk), 


h 1 1 1 
Ёз = hf; (5 + 5:1, + 752,1: w2, + 752,2: Wi + stom) , 


1 
Шыда = Wig + ы + 2k» i T 2833 + ka i]; (8.3.26) 


where 7 = 1, 2,...,m for each of the above. 
A differential equation of high order can be converted into a system of rst-ord er 
equations. Suppose that a single differential equation has the form 


y? = f(ty,y' ys. sy m), ast sb (8.3.27) 
with initial conditions y(a) = a1, y'(a) = o», ..., y" (a) = am. All derivatives 
» . k 
are with respect to t. That is, y) = 20. De ne ш (0) = y(t), us(t) = y'(t), .... 
us (f) = y(t). This yields rst-ord er equations 
аш du» du m—1 dum n ) 
— =u, —— = 13, ... =u —— = U1,U2;...,U 
di 25 di 3, dt т» dt 941,42; » Um): 
(8.3.28) 
with initial conditions из (а) = o1,..., Um(a) = ањ 
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8.3.2.8 Partial differential eguations 


To develop difference eguations for partial differential eguations, one needs to esti- 
mate the partial derivatives of a function, say, u(x, y). For example, 


a, 8 9) = 3 88 — foré € (z, x +h), (8.3.29) 
Ou 1 h? 054461) 


ag 9) = 5; luo +h,y) -2u(z, y) + ulz — h,y)] — D x (8.3.30) 
for € € (z — ћ, 2 +h). 
Notes: 


1. Equation (8.3.29) is simply Equation (8.3.12) applied to estimate the partial 
derivative. It is given here to emphasize its application for forming differ- 
ence equations for partial differential equations. A similar formula applies for 
Ou / Oy, and others could follow from the formulae in Section 8.3.2.1. 


2. An estimate of д2и/ ду? is similar. A formula for 0?u/OxÓy could be given. 
However, in practice, a change of variables is generally used to eliminate this 
mixed second partial derivative from the problem. 


If a partial differential equation involves partial derivatives with respect to only 
one of the variables, the methods described for ordinary differential equations can 
be used. If, however, the equation involves partial derivatives with respect to both 
variables, the approximation of the partial derivatives requires increments in both 
variables. The corresponding difference equations form a system of linear equations 
that must be solved. 

Three specic forms of partial differential equations with popular methods of 
solution are given. The domains are assumed to be rectangular. Otherwise, additional 
considerations must be made for the boundary conditions. 


8.3.2.9 Poisson equation 


The Poisson equation is an elliptic partial differential equation that has the form 


2u 2 


д 
SA (2y) + Foley) = flay) (8.3.31) 


V^ utm) = 2j 


for (x,y) € R= ((z,y) | a < x « b,c « y < d), with u(z,y) = g(x,y) for 
(x,y) € S, where S = OR. When the function f(x,y) = 0 the equation is called 
Laplace's equation. 

To begin, partition [a, b] and [c, d] by choosing integers n and m, de ne step 
sizes h = (b — a)/n and k = (d — c)/m, and set ti = a + ih fori = 0,1,...,n 
and y; = c + jk for j = 0,1,...,m. The lines x = cj, y = yj, are called grid lines 
and their intersections are called mesh points. Estimates ш; ; for u(x, yj) can be 


generated using Equation (8.3.30) to estimate Ыы? апа u, The method described 
here is called the nite-d ifference method. 
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Start with the values 


100,) = 4(20,94), Wn,j = g(£n, yj). Wi,0 = g(zi, Yo), Uim = 0( Ym), 
(8.3.32) 
and then solve the resulting system of linear algebraic eguations 


190% 


һ 2 
шз (Witi j -wi-1,5)— Ө (wig41t+wig—1) = M f (а, уу), 


k 
(8.3.33) 
for i = 1,2,...,n — 1 and j = 1,2,...,m — 1. The local truncation error is 
O(h? + К). 
If the interior mesh points are labeled Pe = (a;,y;) and we = шы; where 


£—1+ (m —1 — j)(n — 1), fori = 1,2,...,n — 1, and j = 1,2,...,m — 1, then 
the two-dimensional array of values becomes a one-dimensional array. This results 
in a banded linear system. The case n = m = 4 yields £ = (n — 1)(m — 1) = 9. 
Using the relabeled grid points, f; = f(P;), the equations at the points P; are 


Pi: Ашу = шә = ша = wog +wis— h fi, 
Py: Дио — шз —W1 —W5 = wz4— р, 

Ps: 4ws — шә — Weg = Was ws — h’ fs, 
Рд: 4w4 — w5 —W1 – шт = W02—h fa, 

P3: 4us 106 104 шә Wg = 0 — h? fs, 

Pe: 4we — Ws — Шз —Wg = W43—h fo, 

Р: Aw; — Wg =w, = W01+W0—h fr, 
Бы Аша — wg — Шт —W5 = Woo – А? fs, 

Po: Awg — wg —W6 = W30+W41— fo, 


where the right-hand sides of the eguations are obtained from the boundary condi- 
tions. 

The following algorithm can be used to solve the Poisson equation. Note that, 
for simplicity, the algorithm incorporates an iterative procedure called Gauss-Seidel 
for solving linear systems. Instead, Gaussian elimination is recommended (because 
stability with respect or round-off errors is assured) when the order is small (say, 
less than 100). For large systems, the SOR (Successive Over-Relaxation) method 
is recommended. The Gauss-Seidel and SOR methods can be found in Burden and 
Faires. 


8.3.2.10 Poisson equation nite-diff erence algorithm 
To approximate the solution to the Poisson equation 
924 924 


7 _ Ou ou 2 
V^u(z,y) = Ox? (x,y) + ду? (x,y) = f(x,y), (8.3.34) 


fora<a<bandc<y<d, 


subject to u(x, y) = g(a, y) if x =a orx = bande y < dandu(z,y) = g(x,y) 
ify > согу = danda < v < b: 
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INPUT endpoints a,b, c, d; integers m > 3, n > 3; tolerance TOL; 
maximum number of iterations N. 
OUTPUT approximations w; j to u(z;, yj) for? = 1,...,n —1 
апа j —1,...,m — 1 ога message that N was exceeded. 
Algorithm: 
1. Seth = (b — a)/n; k = (d — c)/m. 
2. Fori —1,...,n — 1 set z; = а + ih. 
3. For j —1,...,m — l set yj = c + jk. 
4. Fori = 1,...,n— 1 
for j —1,...,m — 1setwj,; = 0. 
‚ Set à = h?/k?: u —2(1 + A); 6-і. 
6. While £ € N do (a)—(1) 
(a) Set 
z = ( — K?’ f (z1, Ym-1) + g(a,Ym—1) + Ag(a1, d) 
+AW1,m—2 + шә,т—1) / Us 
NORM = |z — W1.m—1|:W1,m—1 = 2. 
(b) For i = 2,...,n —2 
set z — ( = ДТ (а, Ym—1) + Ад(ж, d) + Wi—1,m-1 
+Witiym—1 + Аш m —2) / s 
if [Wi,m—1 — 2| > NORM then set NORM = |w; m-1 — 2]; 
Set Wim—1 = 2. 
(c) Setz = ( = h? (шил лал) + g(b, Ym—1) + Ag(zn-1, d) 
TUn-2,m-1 + AWn—1,m—2) / s 
if [Wn—1,m—1 — 2| > NORM then set NORM = |wn—ijm—1 — 2) 
Set Wn—1,m—1 = 2. 
(d) For j = m — 2,...,2 do i-iii. 
1. Setz = (— h? f(x1,y;) + g(a, Vj) + Хал + M1, —1 
tw»,;)/ n; 
if [олу — z| > NORM then set NORM = [шу — z|; 
set W153 = 2. 


сл 


ii. Fori =2,...,n—2 
set z = (—h? f (xi, yj) + wi-1,j + Аи; уул ct wig 
-EÀwi,j—1) / Ms 
if |w;,; — z| > NORM then set NORM = |w;,; — z|; 
set Wi j = 2. 


iii. Set z = (—h? f(x, 21,93) +9(0, yj) +Wn—2,j+AWn-1,j41 
+Awn—1,j-1) /18 
if [Wn—1,j — z| > NORM then set NORM = |wn-1,; — z|; 


Set Wn—1,j = 2. 
(e) Set z = ( — P ааа) + 9(a,y1) + Ag(a1, c) + Ani 


+we,1) /ш 
if [илл — z| > NORM then set NORM = [wi — z|; 
set шр = 2. 
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(f) Fori =2,...,n—2 
set z = ( — P? f (zi, ул) + Ag(zi с) + wizia + Аш; 


+) 
if jwi1 — z| > NORM then set NORM = [wi — z|; 
set ji = 2. 
(g) Set z = (—h? flčn—1,y1) +gb, ул) +Ag(En-1, 6) wn 24 
+Awn—1,2) / Ms 


if [Wn—1,1 — z| > NORM then set NORM = |ш>,-11-2) 
Set Wn—1,1 = 2. 
(h) If NORM < TOL then do i-ii. 
1. Fori = 1,...,n— 1 
for j = 1,...,m — 1 OUTPUT(z;,yj,wi,;). 
ii. STOP. (Procedure successful.) 


(i) Set£ 2 (+1. 


7. OUTPUT( (Maximum number of iterations exceeded.’ ); 
(Procedure unsuccessful.) 
STOP. 


8.3.2.11 Heat or diffusion equation 


The heat, or diffusion, equation is a parabolic partial differential equation of the form 


2 
28 (at = a? P 1), 0<х<4, t»0, (8.3.35) 
where u(0,t) = 0 = u(£, t) = 0, fort > 0, andu(z,0) = f(x), for0 < z < £. An 
ef cient method for solving this type of equation is the Crank-Nicolson method. 
To apply the method, select an integer m > 0, set h = £/m, and select a time- 
step size k. Here 2; = ih, à = 0,...,m and t; = jk, j = 0,.... The difference 
equation is given by: 


Wi j+1 — Ші, 


2 
_ 9 а нет ау pp i pen F Wijt] 2) 


2 h? h? 
(8.3.36) 


and has local truncation error O(k? + h?). The difference equations can be rep- 
resented in the matrix form Aw0+)) = Bw), for each j = 0,1,2,..., where 
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Ach? м = (ші,),Шә,,...,Шт-1,4)!, and the matrices A and В are 


(1531-2403 0 0 0 0 
AO. ALA 212 0 0 0 
0 -2. (+A) 38 0 0 
"UR 0 0 —A/2 (+A) 0 0 
0 0 0 0 (+A) SAJ2 
0 0 0 0 «os AS 
(8.3.37) 
G-A) 28 0 0 0 0 
уа G-A 2302 0 0 0 
0 Х/2- Q-A А0 0 0 
в-| 0 0 Д2 (G-A) 0 0 
0 0 0 0 G-A) 372 
0 0 0 0 Aja (G-A) 


8.3.2.12 Crank-Nicolson algorithm 
To approximate the solution to the parabolic partial differential eguation 
ди д?и 


2 
БЛ (x,t) -а Sog ®t) = 0, 0<r< 5 0< < , 


subject to boundary conditions u(0, t) = u(£,t) = 0 for 0 < t < T, and the initial 
conditions u(z, 0) = f(x) for0 < z < £. 
INPUT endpoint £: maximum time T, constant a: 
integers m > 3; N > 1. 
OUTPUT approximations w; ; to u(z;, tj) fori = 1,...,m — 1, and 
SÍ. ec N. 
Algorithm: 
1. Set h = т k TINA SON Wm = 0. 
2. Fori = 1,...,m — 1 set w; = f(ih). 
3. Set 4 = 1 +A; uj = —AJ (26). 
4. Fori —2,...,m —2 
set 4; 21 + A + Aui 1/2; uj = —A/ (24). 
Set lm 21 = 1+А+ Aug 2/2. 
6. Forj = 1,..., N do (a)-(e). 
(a) Sett = jk: 21 = [(1 - Аш + 512] Га. 
(b) Богі = 2,...,m —1 
set 2; = (1 - Аш; + А (шафт + щш —1 + z-1)| /&. 
(с) Set Wm-1 = Zm—1- 


сл 


(d) For = m — 2,...,1 set ш; = ži — ишт. 
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(e) ООТРОТ(4); (Note: t = tj.) 
Fori = 1,...,m — 1 set z = ih; OUTPUT(z, wi). 
(Note: ш; = wi, j.) 


7. STOP. (Procedure completed.) 


8.3.2.13 Wave eguation 
The wave equation is an example of a hyperbolic partial differential equation and has 
the form 


8%u 220и 

Set- aet), 0«z«4 150 (8.3.38) 
(where a is a constant) subject to u(0,t) = u(£, t) = Ofort > 0,апйи(х,0) = f(x) 
and 28 х, 0) = g(x) for0 € z < €. 


Select an integer m > 0, time-step size k > 0, and using h = £/m, mesh 
points (x;, tj) are de ned by т; = ih and t; = jk. Using ш; j to represent an 
approximation of u(x;, tj) and A = ak/h, the difference equation becomes 


wi41 = 2(1 — A Jwi з +A? (wigi, + Wi-1, j) — Wij, 


with wo,; = Әт, = 0 and wio = Қа), fori = 1,...,m — 1 and j = 1,2,.... 
Also needed is an estimate for ш; 1, foreach? = 1,...,т- 1, which can be written 


№ A? 
wii = (1 А?) f(a) + 3 Газы) + 3 7 (8-4) t Ка). 


The local truncation error of the method is O(h? + k?) but the method is ex- 
tremely accurate if the true solution is in nitely differentiable. For the method to be 
stable, it is necessary that A < 1. The following algorithm, applied with A < 1, is 
O(h? + k?) convergent if f and g are suf ciently differentiable. 


8.3.2.14 Wave equation algorithm 


To approximate the solution to the wave equation 

шын -a ig, t)=0, 0«z«f, 0<t<T, 
subject to u(0, t) = u(£,t) = O for0 < t < T, u(x,0) = f(x) forO € x < £, and 
Č (0,0) = gla) for0 < æ < £ 


INPUT endpoint 2; maximum time T; constant a; integers m > 2; 
N >2. 

OUTPUT approximations w; j to u(z;,1;), i = 0,...,m, j = 0,... 
Algorithm: 


1. Seth = l/m; k = TÍN; A = kafh. 


N. 


, 
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2. Forj = 1,..., N set wo,; = 0; шь у = 0. 
3. Set wo, = f(0); mo = f(O. 
4. Fori = 1,...,m -1 

set шо = Jf (ih); 


2 
wa = 0 - Мун) + ŽAG + DA) 
Tf((i — 1)h)] + kgGh). 

5. Forj = 1,..., N — 1 (Perform matrix multiplication.) 

fori = 1,...,m — 1 set 

шына = 2(1 — А2); з + А? (илз + wi-1,j) + Wij-1- 
6. Forj =1,...,N 

set t = jk; 

for? = 0,...,т 

set r = ih; OUTPUT(z, t, ш; ;). 
7. STOP. (Procedure completed.) 


8.3.3 NUMERICAL SUMMATION 


A sum of the form b / (xo + jh) (п may be in nite) can be approximated by the 
Euler-MacLaurin sum formula, 


n 20-00, 
ээ ТОН 


1—0 


+% I 08-0 (zo + nh) — FOI ( 0) + Em (8.3.39) 


where Em = nh унагаа f 0012) (e), with тор < £ < zo +nh. The В, here are 
Bernoulli numbers (see Section 1.2.7). 

The above formula is useful even when n is in nite, although the error can no 
longer be expressed in this form. A useful error estimate (which also holds when n 
is nite) is that the error is less than the magnitude of the rst neglected term in the 
summation on the second line of Equation (8.3.39) if f 027992) (x) and f "4 (x) do 
not change sign and are of the same sign for то < x < zo + nh. If just f P+?) (x) 
does not change sign in the interval, then the error is less than twice the rst neglected 
term. 

Quadrature formulae result from Equation (8.3.39) using estimates for the 
derivatives. 
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8.4 PROGRAMMING TECHNIQUES 


Ef cienc y and accuracy are the ultimate goal when solving any problem. Listed 
here are several suggestions to consider when developing algorithms and computer 
programs. 


1. Every algorithm must have an effective stopping rule. For example, popular 
stopping rules for iteration methods described in Section 8.1.2 are based on 
the estimate of the absolute error, relative error, or function value. One might 
choose to stop when a combination of the following conditions are satis ed: 


[Dn — Pn-1 | 


< бо, 146731 < єз, 
|рһ| 


|р» = р-а < е, 
where each є; represents a prescribed tolerance. However, since some iter- 
ations are not guaranteed to converge, or converge very slowly, it is recom- 
mended that an upper bound, say N, is speci ed for the number of iterations 
to be performed (see algorithm on page 742). This will avoid in nite loops. 


2. Avoid the use of arrays whenever possible. Subscripted values often do not 
require the use of an array. For example, in Newton’s method (see page 731) 
the calculations may be performed using p = po — BE 2. Then check the 
stopping rule, say, if |p — po| < €, and update the current value by setting 


po = p before computing the next value of the sequence. 


3. Limit the use of arrays when forming tables. A two-dimensional array can 
often be avoided. For example, a divided difference table can be formed and 
printed as a lower triangular matrix. The entries of any row depend only on 
the entries of the preceding row. Thus, one-dimensional arrays may be used 
to save the preceding row and the current row being calculated. It is important 
to note that usually the entire array need not be saved. For example, only 
special values in the table are needed for the coef cients of an interpolating 
polynomial. 


4. Avoid using formulae that may be highly susceptible to round off error. Exer- 
cise caution when computing quotients of extremely small values as in Equa- 
tion (8.3.12) with a very small value of h. 


5. Alter formulae for iterations to obtain a “small correction” to an approxima- 
tion. For example, writing alb as a + 5а іп the bisection method (see 
page 732) is recommended. Many of the iteration formulae in this chapter 


have this form. 


6. Pivoting strategies are recommended when solving linear systems to reduce 
round-off error. 


7. Eliminate unnecessary steps that may increase execution time or round-off 
error. 
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8. Some methods converge very rapidly, when they do converge, but rely on rea- 
sonably close initial approximations. A weaker, but reliable, method (such as 
the bisection method) to obtain such an approximation can be combined with a 
more powerful method (such as Newton’s method). The weaker method might 
converge slowly and, by itself, is not very ef cien t. The powerful method 
might not converge at all. The combination, however, might remedy both dif- 
culties. 
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Chapter 


Financial Analysis 


9.1 FINANCIAL FORMULAE 
9.1.1 Definition of financial terms 
9.1.2 Formulae connecting financial terms 
9.1.3 Examples 


9.2 FINANCIAL TABLES 
9.2.1 Compound interest: find final value 
9.2.2 Compound interest: find interest rate 
9.2.3 Compound interest: find annuity 


9.1 FINANCIAL FORMULAE 


9.1.1 DEFINITION OF FINANCIAL TERMS 


amount that Р is worth, after n time periods, with 2 percent interest per period 
total amount borrowed 

principal to be invested (equivalently, present value) 

future value multiplier after one time period 

percent interest per time period (expressed as a decimal) 

amount to be paid each time period 

number of time periods 


з Š s. 9 до U > 


Note that the units of А, В, Р, and m must all be the same, for example, dollars. 
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9.1.2 FORMULAE CONNECTING FINANCIAL TERMS 


1. Interest: Let the principal amount P be invested at an interest rate of 1% per 
time period (expressed as a decimal), for n time periods. Let A be the amount 
that this is worth after n time periods. Then 


(a) Simple interest: 


A 
ABS dnd Pe 2 =. pi quo e reed 
(1+ni) an (+a) and i=—(5 
(9.1.1) 


(b) Compound interest (see the tables beginning on page 783 for А and the 
tables beginning on page 785 for 4): 
A 1/n 
and i= (5 - 1. 


А 
(1+ 1)" P 
(9.1.2) 


When interest is compounded g times per time period for n time periods, 
it is equivalent to an interest rate of (i/q)% per time period for ng time 


periods. 
ТАЛЫН 
А-Р(161) , 
Ч 


ү" 
r-a(1+2) (9.1.3) 


97-| 


Continuous compounding occurs when the interest is compounded ш- 
finitely often in each time period (i.e., g > оо). In this case: A = Pe”. 


A=P(1+i)” and P= 


1-4 


2. Present value: If А is to be received after n time periods of 790 interest per 
time period, then the present value P of such an investment is given by (from 
Equation (9.1.2)) Р = А(1 4- i) 7. 


3. Annuities: Suppose that the amount B (in dollars) is borrowed, at a rate of 1% 
per time period, to be repaid at a rate of m (in dollars) per time period, for a 
total of n time periods. Then (see the tables beginning on page 787): 


. (+i) 
= Bi——— 9.1.4 
RUE Eel DIE 
m 1 
В---|(1-----|. 9.1.5 
4 ( (1 x) ( ) 
Using a = (1 + i), these equations can be written more compactly as 
Ё 1 
т = Bi— ad B-— (i-i) (9.1.6) 
а" —1 i а" 
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9.1.3 EXAMPLES 


1. Question: If $100 is invested at 5% per year, compounded annually for 10 
years, what is the resulting amount? 


e Analysis: Using Equation (9.1.2), we identify 
(a) Principal invested, P = 100 (the units are dollars) 
(b) Time period, 1 year 
(c) Interest rate per time period, 7 = 5% = 0.05 
(d) Number of time periods, n = 10 


е Answer: А = P(1 + i)" or A = 100(1 + 0.05)!? = $162.89. 
(Or, see tables starting on page 783.) 


2. Question: If $100 is invested at 5% per year and the interest is compounded 
quarterly (4 times a year) for 10 years, what is the final amount? 


e Analysis: Using Equation (9.1.3) we identify 
(a) Principal invested, P = 100 (the units are dollars) 
(b) Time period, 1 year 
(c) Interest rate per time period, 7 = 5% = 0.05 
(d) Number of time periods, n — 10 
(е) Number of compounding time periods, g = 4 


e Answer: A= Р (1+ a or A = 100(1 + 20ž)410 = 100(1.0125)40 
= $164.36. 

Alternate analysis: Using Equation (9.1.2), we identify 

(a) Principal invested, P = 100 (the units are dollars) 

(b) Time period, quarter of a year 

(c) Interest rate per time period, % = ын = 0.05 = 0.0125 

(4) Number of time periods, n = 10 : 4 = 40 


е Alternate answer: A = Р(1 + i)" or A = 100(1.0125)^? = $164.36. 
(Or, see tables starting on page 783.) 


3. Ouestion: If $100 is invested now, and we wish to have $200 at the end of 10 
years, what yearly compound interest rate must we receive? 


e Analysis: Using Equation (9.1.2), we identify 
(a) Principal invested, P = 100 (the units are dollars) 
(b) Final amount, A = 200 
(с) Time period, 1 year 
(d) Number of time periods, n = 10 
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e Answer: i = (4)“" —1 ori = (2%0)!/1°— = 0.0718. (Or, see tables 
starting on page 785.) Hence, we must receive an annual interest rate of 


7.2%. 


4. Question: An investment returns $10,000 in 10 years time. If the interest rate 
will be 10% per year, what is the present value? (That is, how much money 
would have to be invested now to obtain this amount in ten years?) 


e Analysis: Using Equation (9.1.2), we identify 
(a) Final amount, A = 10,000 (the units are dollars) 
(b) Time period, 10 years 
(c) Interest rate per time period, 2 = 10% = 0.1 
(d) Number of time periods, n = 10 


е Answer: Р = А(1 + 7)" = 10000(1.1)-19 = 3855.43; the present 
value of this investment is 3,855.43. (Or, the table on page 784 gives 
the value 2.5937; the present value of this investment is then 510,000 = 


3, 850.43). 


5. Ouestion: A mortgage of $100,000 is obtained with which to buy a house. 
The mortgage will be repaid at an interest rate of 9% per year, compounded 
monthly, for 30 years. What is the monthly payment? 


e Analysis: Using Equation (9.1.6), we identify 
(a) Amount borrowed, В = 100, 000 (the units are dollars) 
(b) Time period, 1 month 
(c) Interest rate per time period, i = 0.09/12 = 0.0075 
(d) Number of time periods, n = 30 · 12 = 360 


e Answer: a = 1 + i = 1.0075 and т = Bi 2 = (100, 000)(.0075) 


EEG — 804.62. (Or, see tables starting on page 787.) The 


monthly payment is $804.62. 


6. Question: Suppose that interest rates on 15-year mortgages are currently 6%, 
compounded monthly. By spending $800 per month, what is the largest mort- 


gage obtainable? 


e Analysis: Using Equation (9.1.6), we identify 
(a) Time period, 1 month 
(b) Payment amount, m = 800 (the units are dollars) 
(c) Interest rate per time period, i = 0.06/12 = 0.005 
(d) Number of time periods, n = 15-12 = 180 


е Answer: а = 1+i = 1.005 and В = % (1 — i) = 0005 (1 — oor) 


= 94802.81. (Or, see tables starting on page 787.) The largest mortgage 
amount obtainable is $94,802.81. 
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9.2 FINANCIAL TABLES 


9.2.1 COMPOUND INTEREST: FIND FINAL VALUE 


These tables use Eguation (9.1.2) to determine the final value in dollars (4) when 
one dollar (Р = 1) is invested at an interest rate of ғ per time period, the length of 
investment time being n time periods. For example, if $1 is invested at a return of 
3% per time period, for 60 time periods, then the final value would be $5.89 (see the 
following table). Analogously, if $10 had been invested, then the final value would 


be $59.92. 


ЕШ 


1.0201 
1.0406 
1.0615 
1.0829 
1.1046 
1.1268 
1.2202 
1.2697 
1.4308 
1.6122 
1.8167 
2.0471 


zm 


1.0816 
1.1699 
1.2653 
1.3686 
1.4802 
1.6010 
2.1911 
2.5633 
4.1039 
6.5705 
10.5196 
16.8423 


1.5096 
1.0302 
1.0614 
1.0934 
1.1265 
1.1605 
1.1956 
1.3469 
1.4295 
1.7091 
2.0435 
2.4432 
2.9212 


4.50% 
1.0920 
1.1925 
1.3023 
1.4221 
1.5530 
1.6959 
2.4117 
2.8760 
4.8774 
8.2715 
14.0274 
23.7888 
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Interest rate (2) 


2.00% 2.50% 


Interest rate (1) 


5.0096 
1.1025 
1.2155 
1.3401 
1.4775 
1.6289 
1.7959 
2.6533 
3.2251 
5.7918 
10.4013 
18.6792 
33.5451 


5.5096 
1.1130 
1.2388 
1.3788 
1.5347 
1.7081 
1.9012 
2.9178 
3.6146 
6.8721 
13.0653 


3.00% 
1.0609 
1.1255 
1.1941 
1.2668 
1.3439 
1.4258 
1.8061 
2.0328 
2.8983 
4.1322 
5.8916 
8.4000 


6.00% 
1.1236 
1.2625 
1.4185 
1.5938 
1.7909 
2.0122 
3.2071 
4.0489 
8.1472 


3.50% 
1.0712 
1.1475 
1.2293 
1.3168 
1.4106 
1.5111 
1.9898 
2.2833 
3.4503 
5.2136 
7.8781 

11.9043 


6.50% 
1.1342 
1.2865 
1.4591 
1.6550 
1.8771 
2.1291 
3.5236 
4.5331 
9.6513 


16.3939 20.5485 
24.8398 32.9877 43.7498 
47.2256 66.3777 93.1476 


7.00% 


1.1449 
1.3108 
1.5007 
1.7182 
1.9671 
2.2522 
3.8697 
5.0724 
11.4239 
25.7289 
57.9464 
130.5065 


7.50% 
1.1556 
1.3355 
1.5433 
1.7835 
2.0610 
2.3818 
4.2478 
5.6729 
13.5115 
32.1815 


76.6492 101.2571 
182.5616 254.9825 


10.00% 10.50% 


1.2100 
1.4641 
1.7716 
2.1436 
2.5937 
3.1384 
6.7275 
9.8497 
30.9127 
97.0172 
304.4816 
955.5938 


I 


1.2769 
1.6305 
2.0819 
2.6584 
3.3946 
4.3345 
11.5231 
18.7881 
81.4374 
352.9923 
1530.0535 


1.2210 
1.4909 
1.8204 
2.2228 
2.7141 
3.3140 
7.3662 
10.9823 
36.3950 
120.6117 
399.7023 
1324.5978 


13.50% 
1.2882 
1.6595 
2.1378 
2.7540 
3.5478 
4.5704 

12.5869 

20.8882 
95.4665 
436.3162 


Interest rate (1) 


8.00% 
1.1664 
1.3605 
1.5869 
1.8509 
2.1589 
2.5182 
4.6610 
6.3412 


8.50% 9.00% 
1.1772 1.1881 
1.3859 1.4116 
1.6315 1.6771 
1.9206 1.9926 
2.2610 2.3674 
2.6617 2.8127 
5.1120 5.6044 
7.0846 7.9111 


15.9682 18.8569 222512 
40.2106 50.1912 62.5852 


133.5932 176.0313 
355.5831 495.1170 


Interest rate (1) 


11.00% 
1.2321 
1.5181 
1.8704 
2.3045 
2.8394 
3.4985 
8.0623 

12.2392 

42.8181 
1497970 
524.0572 


1833.3884  2533.9057 3497.0161 


11.50% 12.00% 


9.50% 
1.1990 
1.4377 
1.7238 
2.0669 
2.4782 
2.9715 
6.1416 
8.8296 

26.2366 
77.9611 
231.6579 
688.3615 


12.50% 


1.2432 1.2544 1.2656 
1.5456 1.5735 1.6018 
1.9215 1.9738 2.0273 
2.3889 2.4760 2.5658 
2.9699 3.1059 3.2473 
3.6923 3.8960 4.1099 
8.8206 9.6463 10.5451 
13.6332 15.1786 16.8912 
50.3379 59.1356 69.4210 
185.8633 230.3908 285.3127 
686.2653 897.5969 1172.6039 


Interest rate (1) 


14.00% 
1.2996 
1.6890 
2.1950 
2.8526 
3.7072 
4.8179 

13.7435 

23.2122 
111.8342 
538.8066 


14.50% 15.00% 


1.3110 
1.7188 
2.2534 
2.9542 
3.8731 
5.0777 


1.3225 
1.7490 
2.3131 
3.0590 
4.0456 
5.3502 


15.0006 16.3665 


25.7829 2 
130.9174 15 
664.757] 81 


8.6252 


4819.2740 


15.50% 
1.3340 
1.7796 
2.3741 
3.1671 
4.2249 
5.6362 

17.8501 


31.7664 


3.1518 179.0406 


9.4007 


1009. 1024 


1994.1218 2595.9187 3375.4307 4383.9987 5687.4691 
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9.2.2 COMPOUND INTEREST: FIND INTEREST RATE 


These tables use Equation (9.1.2) to determine the compound interest rate 2 that must 
be obtained from an investment of one dollar (P — 1) to yield a final value of A (in 
dollars) when the initial amount is invested for n time periods. For example, if $1 is 
invested for 60 time periods, and the final amount obtained is $4.00, then the actual 
interest rate has been 2.3446 per time period (see the following table). Analogously, 
if $100 had been invested, and the final amount was $400, then the interest rate would 
also be 2.3496 per time period. 


Annuity (A) 
2.5 3.0 3.5 4.0 

250.00 300.00 350.00 

87.08 100.00 112.13 

5183 58.74 65.10 

36.78 4142 45.65 

2847 31.95 35.10 

13.35 14.87 16.23 

11.00 12.25 13.35 

6.46 7.18 7.81 

5.36 5.95 6.47 

3.54 3.93 4.27 

2.64 2.93 3.18 

2.11 2.34 2.54 

1.75 1.94 2.11 


Annuity (A) 
5.5 6.0 6.5 7.0 

550.00 600.00 650.00 

154.95 164.57 173.86 

86.63 91.29 95.74 

59.67 62.66 65.49 

4541 47.58 49.63 

20.58 2148 22.32 

16.88 17.61 18.28 

9.81 10.22 10.60 

8.11 8.45 8.76 

5.34 5.55 5.76 

3.98 4.14 4.29 

3.17 3.30 3.42 

2.63 2.74 2.84 
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Annuity (А) 

9.0 9.5 10.0 10.5 
850.00 900.00 950.00 
208.22 216.23 224.04 
111.79 115.44 118.98 

75.56 77.83 80.01 
56.87 58.49 60.04 
25.25 25.89 26.51 
20.64 21.15 21.65 
1191 1220 12.48 
983 1007 10.29 
6.45 6.61 6.75 
4.80 4.91 5.02 
3.82 3.91 4.00 
3.18 3.25 3.32 


Annuity (А) 


231.66 
122.40 


12.0 13.0 14.0 
1300.00 
274.17 


141.01 


15.0 
1400.00 1 

287.30 

146.62 


16.0 
500.00 
300.00 
151.98 


82.12 
61.54 
27.10 
22.12 
12.74 
10.51 
6.89 
5.12 
4.08 
3.39 


тт 


1600.00 


93.43 
69.52 
30.20 
24.60 
14.11 
11.62 
7.61 
5.65 
4.50 
3.73 


96.80 
71.88 
31.10 
25.32 
14.50 
11.95 
7.81 
5.80 
4.62 
3.83 


100.00 
74.11 
31.95 
25.99 
14.87 
12.25 

8.01 
5.95 
4.73 
3.93 


Annuity (A) 


18.0 19.0 20.0 25.0 30.0 


1900.00 2400.00 2900.00 


312.31 
157.13 
103.05 
76.23 
32.75 
26.63 
15.22 
12.53 
8.19 
6.08 
4.83 
4.01 


347.21 
171.44 
111.47 
82.06 
34.93 
28.36 
16.16 
13.29 
8.68 
6.44 
5.12 
4.25 
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400.00 
192.40 
123.61 
90.36 
37.97 
30.77 
17.46 
14.35 
9.35 
6.94 
5.51 
4.57 


447.72 
210.72 
134.03 
97.44 
40.51 
32.77 
18.54 
15.22 
9.91 
7.34 
5.83 
4.84 


9.2.3 COMPOUND INTEREST: FIND ANNUITY 


These tables use Equation (9.1.4) to determine the annuity (or mortgage) payment 
that must be paid each time period, for n time periods, at an interest rate of 7% per 
time period, to pay off a loan of one dollar (B = 1). For example, if $1 is borrowed 
at 3% interest per time period, and the amount is to be paid back in equal amounts 
over 10 time periods, then the amount paid back per time period is $0.12 (see the fol- 
lowing table). Analogously, if $100 had been borrowed, then the mortgage amount 
would be $11.72. 


m Interest rate (7) 
n 


2.00% 225% 2.50% 2.75% 3.0090 3.2596 
1.0200 1.0225 1.0300 1.0325 
0.5151 0.5169 0.5226 0.5245 
0.3468 0.3484 0.3535 0.3552 
0.2626 0.2642 0.2690 0.2706 
0.2122 0.2137 0.2183 0.2199 
0.1785 0.1800 0.1846 0.1861 
0.1545 0.1560 0.1605 0.1620 
0.1365 0.1380 0.1425 0.1440 
0.1225 0.1240 0.1284 0.1299 
0.1113 0.1128 0.1172 0.1187 
0.0946 0.0960 0.1005 0.1020 
0.0612 0.0626 0.0672 0.0688 
0.0529 0.0544 0.0590 0.0607 
0.0392 0.0408 0.0458 0.0475 
0.0263 0.0282 0.0340 0.0361 


Interest rate (2) 

3.50% 375% 4.00% 4.25% 4.50% 4.75% 
1.0350 1.0375 1.0450 1.0475 
0.5264 0.5283 0.5340 0.5359 
0.3569 0.3586 0.3638 0.3655 
0.2722 0.2739 0.2787 0.2804 
0.2215 0.2230 0.2278 0.2294 
0.1877 0.1892 0.1939 0.1955 
0.1635 0.1651 0.1697 0.1713 
0.1455 0.1470 0.1516 0.1532 
0.1315 0.1330 0.1376 0.1391 
0.1202 0.1218 0.1264 0.1279 
0.1035 0.1050 0.1097 0.1112 
0.0704 0.0720 0.0769 0.0785 
0.0623 0.0639 0.0690 0.0707 
0.0493 0.0511 0.0566 0.0585 
0.0382 0.0403 0.0470 0.0492 
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Interest rate (1) 
n 
1.0600 1.0625 
0.5454 0.5474 
0.3741 0.3758 
0.2886 0.2903 
0.2374 0.2390 
0.2034 0.2050 
0.1791 0.1807 
0.1610 0.1626 
0.1470 0.1486 
0.1359 0.1375 
0.1193 0.1209 
0.0872 0.0890 
0.0797 0.0815 
0.0684 0.0704 
0.0609 0.0633 


Е Interest rate (%) 
n 


6.50% 6.75% 7.00% 725% 7.50% 7.7596 
1.0650 1.0675 1.0750 1.0775 
0.5493 0.5512 0.5560 0.5588 
0.3776 0.3793 0.3845 0.3863 
0.2919 0.2936 0.2986 0.3002 
0.2406 0.2423 0.2472 0.2488 
0.2066 0.2082 0.2130 0.2147 
0.1823 0.1839 0.1888 0.1904 
0.1642 0.1658 0.1707 0.1724 
0.1502 0.1519 0.1568 0.1584 
0.1391 0.1407 0.1457 0.1474 
0.1226 0.1242 0.1293 0.1310 
0.0908 0.0926 0.0981 0.1000 
0.0834 0.0853 0.0911 0.0930 
0.0725 0.0746 0.0810 0.0832 
0.0657 0.0681 0.0754 0.0779 
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9.50% 


1.0950 
0.5723 
0.3986 
0.3121 
0.2604 
0.2263 
0.2020 
0.1840 
0.1702 
0.1593 
0.1432 
0.1135 
0.1071 
0.0988 
0.0951 


10.00% 
1.1000 
0.5762 
0.4021 
0.3155 
0.2638 
0.2296 
0.2054 
0.1874 
0.1736 
0.1628 
0.1468 
0.1175 
0.1113 
0.1033 
0.1001 
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Interest rate (2) 


n | 8.00% 8.25% 8.50% 8.75% 9.00% 9.25% 


1.0900 1.0925 


0.5685 
0.3951 


Interest rate (2) 


10.50% 
1.1050 
0.5801 
0.4057 
0.3189 
0.2672 
0.2330 
0.2088 
0.1909 
0.1771 
0.1663 
0.1504 
0.1215 
0.1155 
0.1080 
0.1051 


11.00% 


0.3087 
0.2571 
0.2229 
0.1987 
0.1807 
0.1668 
0.1558 
0.1396 
0.1095 
0.1030 
0.0942 
0.0902 


11.50% 
1.1150 
0.5878 
0.4128 
0.3258 
0.2740 
0.2398 
0.2157 
0.1978 
0.1841 
0.1734 
0.1577 
0.1297 
0.1241 
0.1173 
0.1150 


0.5704 
0.3968 
0.3104 
0.2588 
0.2246 
0.2004 
0.1824 
0.1685 
0.1575 
0.1414 
0.1115 
0.1051 
0.0965 
0.0927 


12.00% 
1.1200 
0.5917 
0.4163 
0.3292 
0.2774 
0.2432 
0.2191 
0.2013 
0.1877 
0.1770 
0.1614 
0.1339 
0.1285 
0.1221 
0.1200 


D 


1.1250 
0.5956 
0.4199 
0.3327 
0.2808 
0.2467 
0.2226 
0.2048 
0.1913 
0.1806 
0.1652 
0.1381 
0.1329 
0.1268 
0.1250 


155377 


1.1550 
0.6190 
0.4416 
0.3538 
0.3019 
0.2678 
0.2440 
0.2265 
0.2133 
0.2031 
0.1884 
0.1642 
0.1600 
0.1559 
0.1550 


13.00% 
1.1300 
0.5995 
0.4235 
0.3362 
0.2843 
0.2501 
0.2261 
0.2084 
0.1949 
0.1843 
0.1690 
0.1424 
0.1373 
0.1316 
0.1300 


16.00% 
1.1600 
0.6230 
0.4453 
0.3574 
0.3054 
0.2714 
0.2476 
0.2302 
0.2171 
0.2069 
0.1924 
0.1687 
0.1647 
0.1608 
0.1600 
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Interest rate (1) 


13.50% 


14.00% 


Interest rate (1) 


16.50% 
1.1650 
0.6269 
0.4489 
0.3609 
0.3090 
0.2750 
0.2513 
0.2339 
0.2209 
0.2108 
0.1964 
0.1732 
0.1693 
0.1657 
0.1650 


17.00% 


14.50% 
1.1450 
0.6112 
0.4344 
0.3467 
0.2948 
0.2607 
0.2368 
0.2192 
0.2059 
0.1955 
0.1806 
0.1554 
0.1509 
0.1461 
0.1450 


17.50% 
1.1750 
0.6348 
0.4562 
0.3681 
0.3162 
0.2823 
0.2586 
0.2415 
0.2285 
0.2186 
0.2045 
0.1822 
0.1787 
0.1755 
0.1750 


15.00% 
1.1500 
0.6151 
0.4380 
0.3503 
0.2983 
0.2642 
0.2404 
0.2228 
0.2096 
0.1993 
0.1845 
0.1598 
0.1554 
0.1510 
0.1500 


18.00% 
1.1800 
0.6387 
0.4599 
0.3717 
0.3198 
0.2859 
0.2624 
0.2452 
0.2324 
0.2225 
0.2086 
0.1868 
0.1835 
0.1805 
0.1800 
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10.1 UNITS 


10.1.1 SI SYSTEM OF MEASUREMENT 


SI, the abbreviation of the French words "Systeme Internationale d'Unites", is the 
accepted abbreviation for the International Metric System. 


1. There are seven base units 


Quantity measured 


Length meter 
Mass kilogram 
Time second 
Amount of substance mole 
Electric current ampere 
Luminous intensity candela 
Thermodynamic temperature | kelvin 


Quantity SI Name Symbol | Combination of 
other SI units 
(or base units) 
Absorbed dose gray 
Activity (radiation source) | becquerel 
Capacitance farad 
Catalytic activity katal 
Celsius temperature degree Celsius 
Conductance siemen 
Dose equivalent sievert 
Electric charge coulomb 
Electric potential volt 
Electric resistance ohm 
Energy joule 
Force newton 
Frequency hertz 
Illuminance lux 
Inductance henry 
Luminous flux lumen 
Magnetic flux density tesla 
Magnetic flux weber Vs 
Plane angle radian т.т” 
(unitless) 
Power watt J/s 
Pressure or stress pascal N/m? 
Solid angle steradian т? m~? 
(unitless) 


1 
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3. The following units are accepted for use with SI units. 


(angle) degree B 1° = (7/180) rad 

(angle) minute 1' = (1/60)? = (7 /10800) rad 
(angle) second 1" = (1/60)' = (т/648000) rad 
(time) day 1 d = 24 h = 86400 s 

(time) hour 1 h = 60 min = 3600 s 

(time) minute 1 1 min = 60 s 


astronomical unit 1 au ss 1.49598 x 101! m 
bel 1 B = (1/2) In 10 Np 

(Note that 1 dB — 0.1 B) 
electronvolt 1 eV = 1.6021764 x 1071? C 
liter 1L — 1 dm? = 107? m? 
metric ton 1t- 10? kg 
neper 1 Np = 1 (unitless) 
unified atomic mass unit lu zz 1.66054 х 10777 kg 


4. The following units are currently accepted for use with SI units (subject to 
further review). 


1Á— 0.1 nm = 107!% m 
la=1 dam? = 10“ m“ 
1 b = 100 fm? = 10728 m? 
1 bar = 0.1 MPa = 100 kPa = 1000 hPa = 10° Pa 
curie j 1 Ci = 3.7 х 101? Bq 
hectare 1 ha = 1 hm? = 10“ m? 
knot 1 nautical mile per hour = (1852/3600) m/s 
nautical mile 1 nautical mile = 1852 m 
rad 1 rad = 1 cGy = 107? Gy 
rem 1 rem = 1 cSv = 107? Sv 
roentgen 1 R = 2.58 x 1074 C/kg 


10.1.2 UNITED STATES CUSTOMARY SYSTEM OF WEIGHTS 
AND MEASURES 


Linear measure 
5280 feet or 320 rods 
16.5 feet or 5.5 yards 
3 feet 
12 inches 


Linear measure: nautical 


6 feet 

69 miles 

46 nautical miles ғә 53 miles 
6076.1 feet = 1.1508 statute miles 


1 fathom 

1° of latitude 

1° of longitude at 40° latitude 
1 nautical mile 


20001 
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Sguare measure 
1 sguare mile 
1 acre 
Volume measure 
1 cubic yard 
1 cubic foot 
Dry measure 
1 bushel 
1 peck 
1 guart 
Liguid measure 


1 cubic foot 
1 gallon 
1 guart 
1 pint 
Liguid measure: Apothecaries" 


1 pint 
1 fluid ounce 
1 fluid dram 
Weight: Avoirdupois 


Weight: Troy 

1 pound 
1 ounce 
1 pennyweight 

Weight: Apothecaries" 
1 pound 
1 ounce 
1 dram 
1 scruple 


640 acres 
43,560 sguare feet 


27 cubic feet 
1728 cubic inches 


7.4805 gallons 
4 guarts 

2 pints 

4 gills 


16 fluid ounces 
8 drams 
60 minims 


2000 pounds 
16 ounces or 7000 grains 
16 drams or 437.5 grains 


12 ounces 
20 pennyweights 
24 grains 


12 ounces 
8 drams 

3 scruples 
20 grains 


10.1.3 PHYSICAL CONSTANTS 


c (speed of light) = 299,792,458 m/s (exact value) 

е (charge of electron) œ 1.6021764 х 1071° C 

С (gravitational constant) ~ (6.673 + 0.003) x 1078 cm?/g s? 

h (Plank constant over 27) z 1.0545716 х 10734 J s 

k (Boltzmann constant) z 1.38065 x 10773 J/K 

1 knot = 1 nautical mile/hour ~ 1.6878 ft/s ~ 1.1508 statute miles/hr 
Acceleration, sea level, latitude 45° ғә 9.806194 m/s? zz 32.1726 ft/s? 
Avogadro's constant s 6.022142 mol ^! 

Density of mercury, at 09С z 13.5951 g/mL 
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Density of water (maximum), at 3.98°C ғә 0.99997496 g/mL 
Density of water, at 0°C zz 0.9998426 g/mL 

Density of dry air, at 0°C, 760 mm of Hg z 1.2927 g/L 
Earth: equatorial radius ~ 6378.388 km zz 3963.34 statute miles 
Earth: polar radius ~ 6356.912 km zz 3949.99 statute miles 
Earth: mean density zz 5.522 g/cm? ss 344.7 Ib/ft? 

Heat of fusion of water, at 0°C & 333.6 J/g 

Heat of vaporization of water, at 100?C zz 2256.8 J/g 

Mass of hydrogen atom zz 1.67353 x 10:25 g 

Velocity of sound, dry air, at 0°C ғә 331.36 m/s zz 1087.1 ft/s 
Wavelength of orange-red line of krypton 86 ~ 6057.802 A 


10.1.4 DIMENSIONAL ANALYSIS/BUCKINGHAM PI 


The units of the parameters in a system constrain all the derivable quantities, regard- 
less of the equations describing the system. In particular, all derived quantities are 
functions of dimensionless combinations of parameters. The number of dimension- 
less parameters and their forms are given by the Buckingham pi theorem. 

In a system, the quantity и = f(W1, W2, . . ., Wn) is to be determined in terms 
of the n measurable variables and parameters (W;) where f is an unknown func- 
tion. Let the quantities (u, W;} involve m fundamental dimensions labeled by 
Ід,Г2,..., Lm (such as length, mass, time, or charge). The dimensions of any 
of the fu, W;} are given by a product of powers of the fundamental dimensions. For 
example, the dimensions of W; are QU pue әт where the {b;;} are real 
and called the dimensional exponents. A quantity is called dimensionless if all of 
its dimensional exponents are zero. Let b; — [bia bi ... bis]. be the dimen- 
sion vector of W; and let В = (ы b... by, | be the m X n dimension matrix 


T : | 
of the system. Let a = [a1 ag... am] be the dimension vector of u and let 


у= ly w .- Yn] represent a solution of By = —a. Then, 
1. The number of dimensionless quantities is k + 1 = n + 1 — rank( B). 


2. The measurable quantity u can be expressed in terms of dimensionless param- 
eters as 


u = ЕЛ Та Wt M aa Tk) (10.1.1) 


where g is an unknown function of its parameters and the {7;} are dimen- 


sionless quantities. Specifically, let х = [21i d. аа vu]. be one of 
k = n —r(B) linearly independent solutions of the system Bx = 0 and define 
т; = WLW. Were, 
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10.1.5 UNITS OF PHYSICAL QUANTITIES 


In the following, read “kilograms” for the mass M, “meters” for the length L, “sec- 
onds" for the time Т, and “degrees” for the temperature 0. For example, acceleration 
is measured in units of L/T?, or meters per second squared. 


Quantity Quantity 


Acceleration 
Angular acceleration 
Angular frequency 
Angular momentum 
Angular velocity 
Area 

Displacement 


Mass 

Mass density 
Momentum 
Period 

Power 

Pressure 

Moment of inertia 


Energy or work Time 

Energy, kinetic / Torque 
Energy, potential Velocity 
Energy, total Volume 

Force Wavelength 
Frequency Work 
Gravitational field strength / Entropy 
Gravitational potential Internal energy 
Length Heat 


10.1.6 CONVERSION: METRIC TO ENGLISH 


centimeters 0.3937008 | inches 
cubic meters 1.307951 cubic yards 
cubic meters 35.31467 cubic feet 
grams 0.03527396 | ounces 
kilograms 2.204623 pounds 
kilometers 0.6213712 | miles 


liters 0.2641721 | gallons (US) 
meters 1.093613 yards 
meters 3.280840 feet 


milliliters 0.03381402 | fluid ounces 
milliliters 0.06102374 | cubic inches 
square centimeters | 0.1550003 | square inches 
square meters 1.195990 square yards 
square meters 10.76391 square feet 
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10.1.7 CONVERSION: ENGLISH TO METRIC 


Multiply 


cubic feet 
cubic inches 
cubic yards 
feet 

fluid ounces 


gallons (US) 
inches 


miles 

mils 

ounces 
pounds 
square feet 
square inches 
square yards 
yards 


feet of water at 4°C 
inches of mercury at 4°C 
pounds per square inch 
foot-pounds 

joules 

cords 

radian 

foot-pounds 
atmospheres 

miles 

horsepower 
horsepower-hours 
kilowatt-hours 
foot-pounds per second 
atmospheres 

BTU 

foot-pounds 

BTU per minute 
foot-pounds per minute 
horsepower 

miles per hour 
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0.02831685 
16.38706 
0.7645549 
0.3048000 
29.57353 
3.785412 
2.540000 
1.609344 
25.4 
28.34952 
0.4535924 
0.09290304 
6.451600 
0.8361274 
0.9144000 


2.950 x 1072 
3.342 x 10-2 
6.804 x 10-2 
1.285 x 107? 
9.480 x 10-4 
128 
57.29578 
1.356 x 107 
33.90 

5280 

3.3 x 104 
1.98 x 106 
2.655 x 106 
1.818 x 107? 
2.036 
1.055060 x 103 
1.35582 
1.758 x 107? 
2.26 x 1075 
0.7457 
0.8689762 


cubic meters 
milliliters 
cubic meters 
meters 
milliliters 
liters 
centimeters 
kilometers 
micrometers 
grams 
kilograms 
sguare meters 
sguare centimeters 
sguare meters 
meters 


10.1.8 MISCELLANEOUS CONVERSIONS 


atmospheres 
atmospheres 
atmospheres 

BTU 

BTU 

cubic feet 

degree (angle) 

ergs 

feet of water at 4°C 
feet 

foot-pounds per minute 
foot-pounds 
foot-pounds 
horsepower 

inches of mercury at 0°C 
joules 
joules 
kilowatts 
kilowatts 
kilowatts 
knots 


Multiply 
feet 1.893939 x 1074 | miles 
miles 0.8689762 nautical miles 


degrees 1.745329 х 107? | radians 
acres 43560 square feet 
BTU per minute | 17.5796 watts 


10.1.9 TEMPERATURE CONVERSION 


If tr is the temperature in degrees Fahrenheit and їс is the temperature in degrees 


Celsius, then 


5 9 
to — gr — 32) and tp = Fus + 32. (10.1.2) 


—40°C | 0°C | 10°C | 20°C | 87°С | 100°C 
—40°Е | 32°F | 50°F | 68°F | 98.6°F | 212°F 
If Tx is the temperature in kelvin and Тр is the temperature in degrees Rankine, 
then 


5 
Tr = ір + 459.69 апа Тқ = tc + 273.15 = 918: (10.1.3) 


10.2 INTERPRETATIONS OF POWERS OF 10 


10—15 the radius of the hydrogen nucleus (a proton) in meters 
10—11 the likelihood of being dealt 13 top honors in bridge 
10710 the radius of a hydrogen atom in meters 

107° the number of seconds it takes light to travel one foot 
1076 the likelihood of being dealt a royal flush in poker 

10° the density of water is 1 gram per milliliter 

10! the number of fingers that people have 

10? the number of stable elements in the periodic table 

10° the number of hairs on a human scalp 

106 the number of possible chess board positions after 4 moves 
10" the number of seconds in a year 

108 the speed of light in meters per second 

10° the number of heartbeats in a lifetime for most mammals 
1010 the number of people on the earth 

1015 the surface area of the earth in sguare meters 

1016 the age of the universe in seconds 

1018 the volume of water іп the earth’s oceans іп cubic meters 
1019 the number of possible positions of Rubik’s cube 

1021 the volume of the earth in cubic meters 
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1074 the number of grains of sand in the Sahara desert 


1028 the mass of the earth in grams 

1033 the mass of the solar system in grams 
1050 the number of atoms іп the earth 

107% the volume of the universe in cubic meters 


(Note: these numbers have been rounded to the nearest power of ten.) 


10.3 CALENDAR COMPUTATIONS 


10.3.1 LEAP YEARS 


If a year is divisible by 4, then it will be a leap year, unless the year is divisible by 
100 (when it will not be a leap year), unless the year is divisible by 400 (when it will 
be a leap year). Hence the list of leap years includes 1896, 1904, 1908, 1992, 1996, 
2000, 2004, 2008 and the list of non-leap years includes 1900, 1998, 1999, 2001. 


10.3.2 DAY OF WEEK FOR ANY GIVEN DAY 


The following formula gives the day of the week for the Gregorian calendar (1.e., for 
any date after 1582): 


W s (i + [2.6m — 0.2] — 2C +Y + Е + S|) (mod 7) (10.3.1) 


where 


e W is the day of the week (0 = Sunday, ..., 6 = Saturday). 
e kisthe day of the month (1 to 31). 


e m is the month (1 = March, ..., 10 = December, 11 = January, 12 = Febru- 
ary). (January and February are treated as months of the preceding year.) 


e C is century minus one (1997 has С = 19, 2005 has С = 20). 

e Y isthe year (1997 has Y — 97 except Y — 96 for January and February). 
e |.| denotes the integer floor function. 

e The “mod” function returns a non-negative value. 


In any given year the following days fall on the same day of the week: 4/4, 6/6, 8/8, 
10/10, 12/12, 9/5, 5/9, 7/11, 11/7, and the last day of February. 
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EXAMPLE Consider the date 16 March 1997 (for which k = 16, m = 1, С = 19, and 

Y = 97). From Equation (10.3.1), we compute W = 16 + [2.4] — 38+ 97 + | 3T | + 

|| (mod 7) =2+2-3+6+3 +4 (mod 7) = 0 (mod Т). So this date was a 
Sunday. 

Because 7 does not divide 400, January 1 occurs more freguently on some days 

of the week than on others! In a cycle of 400 vears, January 1 and March 1 occur on 


the following days with the following freguencies: 


а Tre [wed [The [FA [Sat] 


January 1 | 58 56 58 57 57 | 58 | 56 
March 1 58 56 58 56 58 | 57 | 57 
10.3.3 NUMBER OF EACH DAY OF THE YEAR 


© 0 3 сл PWN KE 
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15 
16 
17 
18 
19 
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*[n leap years, after February 28, add 1 to the tabulated number. 
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10.4 AMS CLASSIFICATION SCHEME 


00 
01 
03 


04 
05 
06 


08 
11 
12 
13 
14 
15 


16 
17 
18 


19 
20 
22 
26 
28 
30 
31 
32 


33 
34 
35 
37 


39 


40 
41 
42 
43 
44 


General 

History and biography 
Mathematical logic and 
foundations 

This section has been deleted 
Combinatorics 

Order, lattices, ordered algebraic 
structures 

General algebraic systems 
Number theory 

Field theory and polynomials 
Commutative rings and algebras 
Algebraic geometry 

Linear and multilinear algebra; 
matrix theory 

Associative rings and algebras 
Non-associative rings and algebras 
Category theory; homological 
algebra 

K-theory 

Group theory and generalizations 
Topological groups, Lie groups 
Real functions 

Measure and integration 
Functions of a complex variable 
Potential theory 

Several complex variables and 
analytic spaces 

Special functions 

Ordinary differential equations 
Partial differential equations 
Dynamical systems and ergodic 
theory 

Difference and functional 
equations 

Sequences, series, summability 
Approximations and expansions 
Fourier analysis 

Abstract harmonic analysis 
Integral transforms, operational 
calculus 


See www . ams .org/msc/ for details. 
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45 
46 
47 
49 


51 
52 
53 
54 
55 
57 
58 


60 


62 
65 
68 
70 


73 
74 
76 
78 
80 


81 
82 


83 
85 
86 
90 


91 
92 
93 
94 


97 


Integral equations 

Functional analysis 

Operator theory 

Calculus of variations and optimal 
control; optimization 

Geometry 

Convex and discrete geometry 
Differential geometry 

General topology 

Algebraic topology 

Manifolds and cell complexes 
Global analysis, analysis on 
manifolds 

Probability theory and stochastic 
processes 

Statistics 

Numerical analysis 

Computer science 

Mechanics of particles and 
systems 

This section has been deleted 
Mechanics of deformable solids 
Fluid mechanics 

Optics, electromagnetic theory 
Classical thermodynamics, heat 
transfer 

Quantum theory 

Statistical mechanics, structure of 
matter 

Relativity and gravitational theory 
Astronomy and astrophysics 
Geophysics 

Operations research, mathematical 
programming 

Game theory, economics, social 
and behavioral sciences 

Biology and other natural sciences 
Systems theory; control 
Information and communication, 
circuits 

Mathematics education 


10.5 FIELDS MEDALS 


The Fields medal is the most prestigious award that can be bestowed upon a mathe- 
matician. It is awarded to someone no more than 40 vears of age. 


0) 

(2) 

(3) 

4) 

(5) 

(6) 

(7) 

(8) 

(9) 
(10) 
ар 
12) 
13) 
14) 
(15) 
(16) 
(17) 
(18) 
(19) 
(20) 
(21) 
(22) 
(23) 
(24) 
(25) 
(26) 
(27) 
(28) 
(29) 
(30) 
(31) 
(32) 
(33) 
(34) 
(35) 
(36) 
(37) 
(38) 
(39) 
(40) 
(41) 


(42) 


1936 
1936 
1950 
1950 
1954 
1954 
1958 
1958 
1962 
1962 
1966 
1966 
1966 
1966 
1970 
1970 
1970 
1970 
1974 
1974 
1978 
1978 
1978 
1978 
1982 
1982 
1982 
1986 
1986 
1986 
1990 
1990 
1990 
1990 
1994 
1994 
1994 
1994 
1998 
1998 
1998 


1998 


Ahlfors, Lars 
Douglas, Jesse 
Schwartz, Laurent 
Selberg, Atle 
Kodaira, Kunihiko 
Serre, Jean-Pierre 
Roth, Klaus 
Thom, Rene 
Hormander, Lars 
Milnor, John 
Atiyah, Michael 
Cohen, Paul 


Grothendieck, Alexander 


Smale, Stephen 
Baker, Alan 
Hironaka, Heisuke 
Novikov, Serge 
Thompson, John 
Bombieri, Enrico 
Mumford, David 
Deligne, Pierre 
Fefferman, Charles 
Margulis, Gregori 
Quillen, Daniel 
Connes, Alain 
Thurston, William 
Yau, Shing-Tung 
Donaldson, Simon 
Faltings, Gerd 
Freedman, Michael 
Drinfeld, Vladimir 
Jones, Vaughan 
Mori, Shigefumi 
Witten, Edward 
Bourgain, Jean 
Lions, Pierre-Louis 


Yoccoz, Jean-Chrisophe 


Zelmanov, Efim 


Borcherds, Richard E. 


Gowers, William T. 
Kontsevich, Maxim 


McMullen, Curtis T. 
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29 
39 
35 
33 
39 
27 
32 
35 
31 
31 
37 
32 
38 
36 
31 
39 
32 
37 
33 
37 
33 
29 
32 
38 
35 
35 
33 
27 
32 
35 
36 
38 
39 


Harvard University 

MIT 

Universite de Nancy 
Princeton/Inst. for Advanced Study 
Princeton University 

College de France 

University of London 

University of Strasbourg 
University of Stockholm 

Princeton University 

Oxford University 

Stanford University 

University of Paris 

University of California at Berkeley 
Cambridge University 

Harvard University 

Moscow University 

University of Chicago 

University of Pisa 

Harvard University 

THES 

Princeton University 
InstPrbImInfTrans 

MIT 

THES 

Princeton University 

IAS 

Oxford University 

Princeton University 

University of California at San Diego 
Phys. Inst. Kharkov 

University of California at Berkeley 
University of Kyoto 

Princeton/Inst. for Advanced Study 
Princeton/Inst. for Advanced Study 
Universite de Paris-Dauphine 
Universite de Paris-Sud 

University of Wisconsin 
Cambridge University 

Cambridge University 

Institut des Hautes Etudes Scientifiques 
and Rutgers University 

Harvard University 


10.6 GREEK ALPHABET 


For each Greek letter, we illustrate the form of the capital letter and the form of the 
lower case letter. In some cases, there is a popular variation of the lower case letter. 


Greek Greek English oe Greek English 
Alpha 
Beta 
Gamma 
Delta 
Epsilon 
Zeta 
Eta 
Theta 
Iota 
Kappa 
Lambda 
Mu 


Xi 
Omicron 


Sigma 
Tau 
Upsilon 
Phi 

Chi 

Psi 
Omega 


Oe xegumuuouz 


A 
B 
Г 
А 
Е 
2 
Н 
Ө 
1 
K 
A 
M 


E €x BE JI RB AYA o M 


10.7 COMPUTER LANGUAGES 


The following is a sampling of computer languages used by scientists and engineers: 


1. Numerical languages 3. Optimization languages 
e Matlab and Octave s- GAMS (AMPI) 
e C and C++ s MINOS 
e MINTO 
e Fortran 
e Lisp 4. Symbolic languages 
И e Derive 
2. Statistical languages e Maple 
e SPSS e Mathematica 
e Minitab Кейисе 


10.7.1 SOFTWARE CONTACT INFORMATION 


1. Derive http://www .derive.com 

2. Fortran http://www .fortran.com 

3. Maple http://www.maplesoft.com 
4. MathCad http://www.mathsoft.com 
5. Matlab http://www.mathworks.com 
6. Mathematica http://www.wolfram.com 
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10.8 PROFESSIONAL MATHEMATICAL 
ORGANIZATIONS 


1. American Mathematical Society (AMS) 
201 Charles Street, Providence, RI 02904 
Telephone: 800/321-4AMS 


Electronic address: www.ams.org 


2. American Mathematical Association of Two-Year Colleges 
Southwest Tennessee Community College 
5983 Macon Cove, Memphis, TN 38134 
Telephone: 901/333-4643 
Electronic address: www.amatyc.org 


3. American Statistical Association 
1429 Duke Street, Alexandria, VA 22314 
Telephone: 703/684-1221 
Electronic address: www.amstat . org 


4. Association for Symbolic Logic 
Box 742, Vassar College, 124 Raymond Avenue 
Poughkeepsie, New York 12604 
Telephone: 845/437-7080 


Electronic address: www.aslonline.org 


5. Association for Women in Mathematics 
4114 Computer & Space Sciences Building, University of Maryland, 
College Park, MD 20742 
Telephone: 301/405-7892 
Electronic address: www.awm-math.org 


6. Canadian Applied Mathematics Society 
Department of Mathematics and Statistics, Simon Fraser University, 
Burnaby, British Columbia, Canada V5A 1S6 
Telephone: 604/291-3337, 604/291-3332 


Electronic address: www. caims.ca 


7. Canadian Applied and Industrial Mathematics Society 
577 King Edward, Suite 109, Р. О. Box 450, Station A, 
Ottawa, Ontario, Canada K1N 6N5 
Telephone: 613/562-5702 


Electronic address: www.cms.math.ca 


8. Casualty Actuarial Society 
1100 North Glebe Road, Suite 600, Arlington, VA 22201 
Telephone: 703/276-3100 


Electronic address: www. casact.org 
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9. Conference Board of the Mathematical Sciences 
1529 Eighteenth Street, N.W., Washington, DC 20036 
Telephone: 202/293-1170 
Electronic address: www . cbmsweb . org 


10. The Consortium for Mathematics and Its Applications (COMAP) 
57 Bedford Street, Suite 210, Lexington, MA 02420 
Telephone: 800/77-COMAP 


Electronic address: www.comap.com 


11. Council on Undergraduate Research 
Council on Undergraduate Research. 734 15th St. N.W., Suite 550, Washing- 
ton, DC 20005 
Telephone: 202/783-4810 


Electronic address: www.cur.org 


12. The Fibonacci Association 
Chase Building, Dalhousie University 
Halifax, Nova Scotia, Canada B3H 3J5 
Telephone: 902/494-2572 


Electronic address: www.mscs.dal.ca/Fibonacci/ 


13. Institute for Operations Research and the Management Sciences 
(INFORMS) 
940-A Elkridge Landing Road, Linthicum, MD 21090 
Telephone: 800/4IN-FORMS 


Electronic address: www.informs.org 


14. Institute of Mathematical Statistics 
P.O. Box 22718 
Beachwood, OH 44122 
Telephone: 216/295-2340 
Electronic address: www.imstat.org 


15. International Mathematics Union (IMU) 
Estrada Dona Castorina, 110, Jardim Botánico, 
Rio de Janeiro — RJ 22460 Brazil 
Telephone: 55-21-294 9032, 55-21-5111749 


Electronic address: www.mathunion.org 


16. Joint Policy Board for Mathematics 
1 Oxford Street #325, Cambridge, MA 02138 
Electronic address: www. jpbm.org 


17. Kappa Mu Epsilon (кше) 
Electronic address: www.cst.cmich.edu/org/kme.nat 


18. The Mathematical Association of America (MAA) 
1529 Eighteenth Street, N.W., Washington, DC 20036 
Telephone: 202/387-5200 
Electronic address: www.maa.org 
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19. Mathematical Programming Society 
3600 University City Science Center, Philadelphia, PA 19104 
Telephone: 215/382-9800, x323 


Electronic address: www. caam.rice.edu/~mathprog/ 


20. Mu Alpha Theta (1106) 
University of Oklahoma, 610 Elm Avenue, Room 423 
Norman, OK 73019 
Telephone: 405/325-4489 
Electronic address: www.mualphatheta.org 


21. National Association of Mathematicians 
Department of Mathematics, Morehouse College 
Atlanta, GA 30314 


Electronic address: www.caam.rice.edu/^nated/orgs/nam/index.html 


22. The National Council of Teachers of Mathematics 
1906 Association Drive, Reston, VA 22091 
Telephone: 703/620-9840 
Electronic address: www.nctm.org 


23. ORSA (see INFORMS) 


24. Pi Mu Epsilon (тие) 
Electronic address: www. pme-math.org 


25. Rocky Mountain Mathematics Consortium 
Arizona State University, Box 871904, Tempe, AZ 85287 
Telephone: 602/965-3788 
Electronic address: math.1a.asu.edu/^rmmc 


26. Society of Industrial and Applied Mathematics (SIAM) 
3600 University City Science Center, Philadelphia, PA 19104 
Telephone: 215/382-9800 


Electronic address: www.siam.org 


27. The Society for Mathematical Biology 
Electronic address: www.smb.org 


28. Society of Actuaries 
475 North Martingale Road, Suite 800, Schaumburg, IL 60173 
Telephone: 847/706-3500 


Electronic address: www.soa.org 


29. Statistical Society of Canada 
1485 Lapérrire St., Ottawa, Ontario K1Z 758 
Telephone: 613/725-2253 


Electronic address: www.ssc.ca 
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10.9 ELECTRONIC MATHEMATICAL RESOURCES 


1. General web sites related to mathematics 


(a) 


(b) 


(c) 


(d) 


(e) 


(f) 


(g) 


http://dir.yahoo.com/Science/mathematics/ 

A very large list of useful sites relating to mathematics. It is perhaps the best 
place to start researching an arbitrary mathematical question not covered else- 
where in this list. 

http://web.math.fsu.edu/Science/math.html 

The mathematics WWW virtual library has a very comprehensive collection of 
links to other mathematics-related sites. 

http: //mathworld.wolfram.com 

A comprehensive on-line encyclopedia of mathematics with more than 10,000 
entries, 4,000 figures, and 100 animated graphics. 
http://www.sosmath.com 

A collection of sites of mathemical interest on the web. 


http://carbon.cudenver.edu/^hgreenbe/glossary/intro.html 
A mathematical programming glossary. 


http://thesaurus.maths.org 
A mathematical thesaurus. 


http://www.cs.unb.ca/^alopez-o/math-faq/math-faq.html 
The FAQ (frequently asked questions) listing from the news group sci.math. 


2. Web sites that respond to user input 


(a) 


(b) 


(с) 


(4) 


http://www-neos.mcs.anl.gov/ 

The NEOS server for optimization will run many different optimization packages 
on an input user problem. 

http://www.theory.csc.UVic.CA/^cos/ 

The Combinatorial Object Server creates combinatorial objects such as neck- 
laces, permutations, combinations, etc. 
http://www.research.att.com/^njas/sequences/ 

The On-Line Encyclopedia of Integer Sequences allows the "next term" in a 
sequence to be determined. (See page 25.) 
http://www.cecm.sfu.ca/projects/ISC/ 


If a real number is input to the Inverse Symbolic Calculator it will determine 
where this number might have come from. 


3. Societies 


(a) 


(b) 


http://www.ams.org 

The American Mathematical Society with the Combined Membership List of the 
AMS and the Math Reviews subject classifications. 

http://www.maa.org/ 

The Mathematics Association of America. 
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(c) http://www.siam.org/ 

The Society for Industrial and Applied Mathematics. 
(d) http://www. ima.umn. edu 

Institute for Mathematics and its Applications at the University of Minnesota. 
(e) http://www. comap.com 


The Consortium for Mathematics and its Applications, with links appropriate for 
elementary, high school, and college undergraduates. They also sponsor contests 
in mathematics for college students and high school students. 


4. Software 


(a) http://gams.cam.nist.gov 
The Guide to Available Mathematical Software. 


(b) http://www .mathtools.net 
Mathematical tools (programs) in many different computing languages. 


(c) http://www. gnu. org/software/gs1/ 


The GNU scientific library is a freely available numerical library in C and C++. 


(d) http://www.netlib.org 


The master listing for Netlib, containing many standard programs, including lin- 
pack, eispack, hompack, SPARC packages, and ODEpack. 


(е) http://www.nag.co.uk 
The home page of the Numerical Algorithms Group. 


5. Journals, pre-prints, and essays 


(a) http://dlmf.nist.gov 


The “Digital Library of Mathematical Functions” from the National Institute of 
Standards and Technology. 


(b) http://arxiv.org/archive/math 

A mathematics preprint server based at the Los Alamos National Laboratory. 
(c) http://www.mathcad.com/library/Constants/index.htm 

A large collection of essays devoted to constants arising in mathematics. 
(d) http://ejde.math.swt.edu/ 

The Electronic Journal of Differential Equations. 


(e) http://nyjm.albany.edu:8000/nyjm. html 


The New York Journal of Mathematics, the first electronic journal devoted to 
general mathematics. 


(f) http://www.wavelet.org 


The Wavelet Digest contains questions and answers about wavelets, and an- 
nouncements of papers, books, journals, software, and conferences. 


(g) http://www.math.ohio-state.edu/JAT 
The Journal of Approximation Theory. 


(h) http://www.combinatorics.org/ejc-wce.html 
The Electronic Journal of Combinatorics and World Combinatorics Exchange. 
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0) http://rattler .cameron.edu/sujpam/suj pam. html 
The Southwest Journal of Pure and Applied Mathematics. 


6. Miscelleneous mathematical web sites 


(a) http://www.math.hmc.edu/codee/main.html 
The Consortium of Ordinary Differential Eguation Experiments. 


(b) http://www.utm.edu/research/primes/largest.html 
Information about primes, including largest known primes of various types. 


(c) http://www .dartmouth .edu/" chance/index.html 
Material about teaching a “guantitative literacy course". 


(d) http://alephO.clarku.edu/^djoyce/julia/explorer.html 
Useful for exploring the Mandelbrot and Julia sets. 


(e) ftp://megrez.math.u-bordeaux.fr/pub/numberfields/ 


The Computational Number Theory group in Bordeaux has made available (by 
anonymous ftp at the above URL) extensive tables of number fields (almost 
550000 number fields). For the number fields belonging to tables of reasonable 
length, this site contains the signature, the Galois group of the Galois closure of 
the field, the discriminant of the number field, the class number, the structure 
of the class group as a product of cyclic groups, an ideal in the class for each 
class generating these cyclic groups, the regulator, the number of roots of unity 
in the field, a generator of the torsion part of the unit group, and a system of 
fundamental units. 


(f) http://www.eccpage.com 
The Error Correcting Codes (ECC) home page provides free software imple- 
menting several important error-correcting codes. 

(g) http://www.georgehart.com/virtual-polyhedra/vp.html 
An online “Encyclopedia of Polyehdra". 


(h) http://www.earlham.edu/^peters/knotlink.htm 
A collection of internet links related to knots. 


(i) http://www.mathsoft.com/asolve/ 
A large collection of unsolved mathematical problems, and pointers to other col- 
lections. 

1) http://www.clarku.edu/^djoyce/wallpaper 
Pictures and descriptions of the 17 crystallographic groups; see page 307. 


(k) http://hcoonce.math.mankato.msus.edu/ 


The mathematics genealogy project; given the name of a PhD mathematician, 
this site will tell you who their thesis advisor was. 


EXAMPLE The editor-in-chief of this book has the ancestral sequence of advisors: 
D. I. Zwillinger — B. S. White — С. C. Papanicolaou —> J. B. Keller 
— К. Courant — D. Hilbert — C. L. F. Lindemann —— C. F. Klein 
— К. O. S. Lipschitz and J. Plucker — С. P. L. Dirichlet — S. D. Poisson 
— J. L. Lagrange — L. Euler — J. Bernoulli 
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10.10 BIOGRAPHIES ОЕ MATHEMATICIANS 


In alphabetical order: 


њ юэ юэ юэ вэ юэ зэ юэ ы юэ 
SOOO cd ON UC POL OBS ro cd ONU LES жол зе ES 


5) 
Бы 


Agnesi, Maria (page 814) 21. Gerson, Levi ben (page 812) 
Ah"mose (page 810) 22. Hamilton, William Rowan (page 814) 
al-Haytham, Abu Ali (page 811) 23. Hilbert, David (page 816) 
al-Khwarizmi, Muhammad (page 811) 24. Hypatia (page 811) 

al-Tusi, Nasir al-Din (page 811) 25. Jiushao, Qin (page 812) 

Archimedes (page 810) 26. Kovalevskaya, Sofia (page 815) 
Banneker, Benjamin (page 814) 27. Lagrange, Joseph (page 814) 
Bernoulli, Johann (page 813) 28. Leibniz, Gottfried Wilhelm (page 813) 
Bhaskara (page 811) 29. Leonardo of Pisa (page 811) 
Brahmagupta (page 811) 30. Napier, John (page 812) 

Cardano, Gerolamo (page 812) 3]. Newton, Isaac (page 813) 

Cauchy, Augustin-Louis (page 814) 32. Noether, Emmy (page 816) 

Cayley, Arthur (page 815) 33. Pascal, Blaise (page 813) 

Dedekind, Richard (page 815) 34. Poincaré, Henri (page 816) 
Descartes, René (page 812) 35. Ptolemy (page 811) 

Dickson, Leonard Eugene (page 816) 36. Riemann, Georg Bernhard (page 815) 
Euclid (page 810) 37. Stevin, Simon (page 812) 

Euler, Leonhard (page 813) 38. Turing, Alan (page 816) 
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In chronological order: 


Ah'mose (c. 1650 B.C.E.) was the scribe responsible for copying the Rhind Papyrus, the 


most detailed original document still extant on ancient Egyptian mathematics. The 
papyrus contains some 87 problems with solutions dealing with what we consider first- 
degree equations, arithmetic progressions, areas and volumes of rectangular and circu- 
lar regions, proportions, and several other topics. It also contains a table of the results 
of the division of 2 by every odd number from 3 to 101. 


Euclid (c. 300 B.C.E.) is responsible for the most famous mathematics text of all time, the 


Elements. Not only does this work deal with the standard results of plane geometry, 
but it also contains three chapters on number theory, one long chapter on irrational 
quantities, and three chapters on solid geometry, culminating with the construction of 
the five regular solids. The axiom-definition-theorem-proof style of Euclid's work has 
become the standard for formal mathematical writing up to the present day. 


Archimedes (287-212 B.C.E.) not only wrote several works on mathematical topics more 


advanced than Euclid, but also was the first mathematician to derive quantitative results 
from the creation of mathematical models of physical problems on earth. In several of 
his books, he described the reasoning process by which he arrived at his results in 
addition to giving formal proofs. For example, he showed how to calculate the areas of 
a segment of a parabola and the region bounded by one turn of a spiral, and the volume 
of a paraboloid of revolution. 
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Ptolemy (с. 100-178 С.Е. ) 15 most famous for the Almagest, a work in thirteen books, which 
contains a complete mathematical description of the Greek model of the universe with 
parameters for the various motions of the sun, moon, and planets. The first book pro- 
vides the strictly mathematical material detailing the plane and spherical trigonometry, 
all based solely on the chord function, necessary for astronomical computations. 


Hypatia (c. 370-415), the first woman mathematician on record, lived in Alexandria. She 
was given a very thorough education in mathematics and philosophy by her father 
Theon and was responsible for detailed commentaries on several important Greek 
works, including Ptolemy’s Almagest, Apollonius’s Conics, and Diophantus’s Arith- 
metica. 


Brahmagupta (c. 598-670), from Rajasthan in India, is most famous for his Brahmas- 
phutasiddhanta (Correct Astronomical System of Brahma), an astronomical work which 
contains many chapters on mathematics. Among the mathematical problems he con- 
sidered and gave solution algorithms for were systems of linear congruences, quadratic 
equations, and special cases of the Pell equation Da? + 1 = y?. He also gave the 
earliest detailed treatment of rules for operating with positive and negative numbers. 


Muhammad al-Khwarizmi (c. 780—850), originally from Khwarizm in what is now Uzbek- 
istan, was one of the first scholars called to the House of Wisdom in Baghdad by the 
caliph al-Ma’mun. He is best known for his algebra text, in which he gave a careful 
treatment of solution methods for quadratic equations. This Arabic text, after being 
translated into Latin in the twelfth century, provided Europeans with an introduction 
to algebra, a subject not considered by the ancient Greeks. Al-Khwarizmi’s book on 
arithmetic provided Europe with one of its earliest looks at the Hindu-Arabic number 
system. 


Abu Ali ibn al-Haytham (965-1039), who spent much of his life in Egypt, is most famous 
for his work on optics, a work read and commented on for many centuries in Europe. 
In pure mathematics, he developed an inductive procedure for calculating formulae for 
the sums of integral powers of the first n integers, and used the formula for fourth 
powers to calculate the volume of the solid formed by revolving a parabola about a line 
perpendicular to its axis. 


Bhaskara (1114—1185), the most famous of medieval Indian mathematicians, gave a com- 
plete algorithmic solution to the Pell equation. In addition, he dealt with techniques of 
solving systems of linear equations with more unknowns than equations and was famil- 
iar with the basic combinatorial formulae, giving many examples, though no proofs, of 
their use. 


Leonardo of Pisa (1170-1240), often known today as Fibonacci, is most famous for his 
Liber Abbaci (Book of Calculation), which contains the earliest publication of the 
Fibonacci numbers in the problem of how many pairs of rabbits can be bred in one 
year from one pair. Many of the sources of the book are in the Islamic world, where 
Leonardo spent much of his early life. The work contains the rules for computing with 
the new Hindu-Arabic numerals, many practical problems in such topics as calculation 
of profits and currency conversions, and topics now standard in algebra texts such as 
motion problems, mixture problems, and quadratic equations. 


Nasir al-Din al-Tusi (7201—1274) was the head of a large group of astronomers at the ob- 
servatory in Maragha, in what is now Iran. He computed a new set of very accurate 
astronomical tables and developed some new ideas on planetary motion which may 
have influenced Copernicus in working out his heliocentric system. In pure mathe- 
matics, al-Tusi’s attempted proof of the parallel postulate was modified by his son and 
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later published in Rome, where it influenced European work on non-Euclidean geom- 
etry. Al-Tusi also wrote the first systematic work on plane and spherical trigonometry, 
independent of astronomy, and gave the earliest proof of the theorem of sines. 


Qin Jiushao (1202-1261), born in Sichuan, published a general procedure for solving sys- 
tems of linear congruences—the Chinese remainder theorem—in his Shushu jiuzhang 
(Mathematical Treatise in Nine Sections) in 1247, a procedure which makes essential 
use of the Euclidean algorithm. He also gave a complete description of a method for 
solving numerically polynomial equations of any degree. Qin’s method was developed 
in China over a period of a thousand years or more and is very similar to what is now 
called Horner’s method of solution, published by William Horner in 1819. 


Levi ben Gerson (7288-1344) was a French rabbi and also an astronomer, philosopher, 
biblical commentator, and mathematician. His most famous mathematical work is the 
Maasei Hoshev (The Art of the Calculator), which contains detailed proofs of the stan- 
dard combinatorial formulae, some of which use the principle of mathematical induc- 
tion. 


Gerolamo Cardano (1501—1576), a physician and gambler as well as a mathematician, 
wrote one of the earliest works containing systematic probability calculations, not all 
of which were correct. He is most famous, however, for his Ars Magna (The Great 
Art, 1545), an algebra text which contained the first publication of the rules for solving 
cubic equations algebraically. Some of the rules had been discovered earlier in the 
sixteenth century by Scipione del Ferro and Niccoló Tartaglia. 


Francois Viete (1540-1603), a lawyer and advisor to two kings of France, was one of the 
earliest cryptanalysts and successfully decoded intercepted messages for his patrons. 
Although a mathematician only by avocation, he made important contributions to the 
development of algebra. In particular, he introduced letters to stand for numerical con- 
stants, thus enabling him to break away from the style of verbal algorithms of his 
predecessors and treat general examples by formulae rather than by giving rules for 
specific problems. 


Simon Stevin (1548—1620) spent much of his life in the service of Maurice of Nassau, the 
Stadhouder of Holland, as a military engineer, advisor in finance and navigation, and 
quartermaster general of the Dutch army. In his book De Thiende (The Art of Tenths), 
Stevin introduced decimal fractions to Europe, although they had previously been used 
in the Islamic world. Stevin's notation is different from our own, but he had a clear 
understanding of the advantage of decimals and advocated their use in all forms of 
measurement. 


John Napier (1550-1617) was a Scottish laird who worked for years on the idea of pro- 
ducing a table which would enable one to multiply any desired numbers together by 
performing additions. These tables of logarithms first appeared in his 1614 book Miri- 
fici Logarithmorum Canonis Descriptio (Description of the Wonderful Canon of Loga- 
rithms). Napier's logarithms are different from, but related to, natural logarithms. His 
ideas were soon adapted by Henry Briggs, who eventually created the first table of 
common logarithms by 1628. 


René Descartes (7596-1650) published the Geometry in 1637 as a supplement to his philo- 
sophical work, the Discourse on the Method for Rightly Directing One's Reason and 
Searching for Truth in the Sciences. In it, he developed the principles of analytic geom- 
etry, showing how to derive algebraic equations which represented geometric curves. 
The Geometry also contained methods for solving polynomial equations, including the 
modern factor theorem and Descartes' rule of signs. 
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Pierre de Fermat (7601—1665) was a French lawyer who spent his spare time doing mathe- 
matics. Not only was he a coinventor of analytic geometry, although his methods were 
somewhat different from those of Descartes, but he also was instrumental in the early 
development of probability theory and made many contributions to the theory of num- 
bers. He is most remembered for the statement of his so-called “last theorem", that the 
equation x" + y" = z" has no non-trivial integral solution if n > 2, a theorem whose 
proof was finally completed by Andrew Wiles in 1994. 


Blaise Pascal (1623-1662) showed his mathematical precocity with his Essay on Conics 
of 1640 in which he stated his theorem that the opposite sides of a hexagon inscribed 
in а conic section always intersect in three collinear points. Pascal is better known, 
however, for his detailed study of what is now called Pascal's triangle of binomial 
coefficients, the basic facts of which had been known in the Islamic and Chinese worlds 
for centuries. He also introduced the differential triangle in his Treatise on the Sines of 
а Quadrant of a Circle, an idea adopted by Leibniz in his calculus. 


Isaac Newton (1642—1727), the central figure in the Scientific Revolution, is most famous 
for his Philosophiae Naturalis Principia Mathematica (Mathematical Principles of 
Natural Philosophy, 1687), in which he derived his system of the world based on his 
laws of motion and his law of universal gravitation. Over 20 years earlier, however, 
Newton had consolidated and generalized all the material on tangents and areas worked 
out by his predecessors into the magnificent problem solving tool of the calculus. He 
also developed the power series as a method of investigating various transcendental 
functions, stated the general binomial theorem, and, although never establishing his 
methods with the rigor of Greek geometry, did demonstrate an understanding of the 
concept of limit quite sufficient for him to apply the calculus to solve many important 
mathematical and physical problems. 


Gottfried Wilhelm Leibniz (1646—1716), born in Leipzig, developed his version of the 
calculus some ten years after Isaac Newton, but published it much earlier. Leibniz 
based his calculus on the inverse relationship of sums and differences, generalized to 
infinitesimal quantities called differentials. By clever manipulation of differentials, 
based in part on the geometrical model of the differential triangle, Leibniz was able to 
derive all of the basic rules of the differential and integral calculus and apply them to 
solve physical problems expressible in terms of differential equations. Leibniz's d and 
| notation for differentials and integrals turned out to be much more flexible and useful 
than Newton's dot notation and remains the notation of calculus to the present day. 


Johann Bernoulli (1667—1748), one of a number of prominent mathematicians of his Swiss 
family, was one of the earliest proponents of Leibniz's differential and integral calculus. 
Bernoulli helped to stimulate the development of the new techniques by proposing chal- 
lenge problems to mathematicians, the most important probably being that of describ- 
ing the brachistochrone, the curve representing the path of descent of a body between 
two given points in the shortest possible time. Many of the problems he posed required 
the solution of differential equations, and Bernoulli developed many techniques useful 
toward this end, including the calculus of the logarithmic and exponential functions. 


Leonhard Euler (1707—1783), a student of Johann Bernoulli in Basel who became one of 
the earliest members of the St. Petersburg Academy of Sciences founded by Peter the 
Great of Russia, was the most prolific mathematician of all time. His series of analysis 
texts, Introduction to Analysis of the Infinite, Methods of the Differential Calculus, and 
Methods of the Integral Calculus, established many of the notations and methods still in 
use today. Among his numerous contributions to every area of mathematics and physics 
are his development of the calculus of the trigonometric functions, the establishment 
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of the theory of surfaces in differential geometry, and the creation of the calculus of 
variations. 


Maria Agnesi (1718-1799), the eldest child of a professor of mathematics at the University 
of Bologna, in 1748 published the clearest text on calculus up to that point. Based 
on the work of Leibniz and his followers, the work explained concepts lucidly and 
provided numerous examples, including some that have become standard in calculus 
texts to this day. Curiously, her name is often attached to a small item in her book not 
even original with her, a curve whose equation was y = pavers This curve was 
called la versiera, derived from the Latin meaning “to turn”; unfortunately the word 
also was the abbreviation of the Italian word meaning “wife of the devil” and so was 
translated into English as “witch”. The curve has ever since been known as the “witch 
of Agnesi". 


Benjamin Banneker (1731—1806), the first American black to achieve distinction in sci- 
ence, taught himself sufficient mathematics and astronomy to publish a series of well- 
regarded almanacs in the 1790s. He also assisted Andrew Ellicott in the survey of the 
boundaries of the District of Columbia. He was fond of solving mathematical puzzles 
and problems and recorded many of these in his notebooks. 


Joseph Lagrange (7736-1813), was born in Turin, becoming at age 19 a professor of math- 
ematics at the Royal Artillery School there. He is most famous for his Analytical 
Mechanics (1788), a work which extended the mechanics of Newton and Euler, and 
demonstrated how problems in mechanics can generally be reduced to solutions of or- 
dinary or partial differential equations. In 1797 he published his Theory of Analytic 
Functions, which attempted to reduce the ideas of calculus to those of algebraic anal- 
ysis by assuming that every function could be represented as a power series. Although 
his central idea was incorrect, many of the proofs of basic theorems of calculus in this 
work were subsequently adapted by Cauchy into the forms still in use today. 


Carl Friedrich Gauss (7777-1855) published his important work on number theory, the 
Disquisitiones Arithmeticae, when he was only 24, a work containing not only an exten- 
sive discussion of the theory of congruences, culminating in the quadratic reciprocity 
theorem, but also a detailed treatment of cyclotomic equations in which he showed how 
to construct regular n-gons by Euclidean techniques whenever n is prime and n — 1 is 
a power of 2. Gauss also made fundamental contributions to the differential geometry 
of surfaces in his General Investigations of Curved Surfaces in 1827, as well as to com- 
plex analysis, astronomy, geodesy, and statistics during his long tenure as a professor at 
the University of Góttingen. Many ideas later published by others, including the basics 
of non-Euclidean geometry, were found in his notebooks after his death. 


Augustin-Louis Cauchy (1789—1857), the most prolific mathematician of the nineteenth 
century, wrote several textbooks in analysis for use at the École Polytechnique, text- 
books which became the model for calculus texts for the next hundred years. In his 
texts, Cauchy based the calculus on the notion of limit, using, for the first time, a def- 
inition which could be applied arithmetically to give proofs of some of the important 
results. Among numerous other subjects to which he contributed important ideas were 
complex analysis, in which he gave the first proof of the Cauchy integral theorem, the 
theory of matrices, in which he demonstrated that every symmetric matrix can be diag- 
onalized by use of an orthogonal substitution, and the theory of permutations, in which 
he was the earliest to consider these from a functional point of view. 


William Rowan Hamilton (1805—1865) became the Astronomer Royal of Ireland in 1827 
because of his original work in optics accomplished during his undergraduate years 
at Trinity College, Dublin. In 1837, he showed how to introduce complex numbers 
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into algebra axiomatically by considering a + ib as a pair (a, b) of real numbers with 
appropriate computational rules. After many years of seeking an appropriate definition 
for multiplication rules for triples of numbers which could be applied to vector analysis 
in three-space, he discovered that it was in fact necessary to consider quadruplets of 
numbers. It was out of the natural definition of multiplication of these quaternions that 
the modern notions of dot product and cross product of vectors evolved. 


Karl Weierstrass (1815—1897) taught for many years at German gymnasia before producing 
a series of brilliant mathematical papers in the 1850s which resulted in his appointment 
to a professorship at the University of Berlin. It was in his lectures there that he insisted 
on defining every concept of analysis arithmetically, including such ideas as uniform 
convergence and uniform continuity, thus completing the transformation away from the 
use of terms such as “infinitely small”. Since he himself never published many of these 
ideas, his primary influence was through the work of his numerous students. 


Arthur Cayley (1821—1895), although graduating from Trinity College, Cambridge, as Se- 
nior Wrangler, became a lawyer because there was no suitable mathematics position 
available in England. He produced nearly 300 mathematical papers during his 14 years 
as a lawyer, however, and finally secured a professorship at Cambridge in 1863. Among 
his numerous mathematical achievements are the earliest abstract definition of a group 
in 1854, out of which he was able to calculate all possible groups of order up to eight 
and the basic rules for operating with matrices, including a statement (without rigor- 
ous proof) of the Cayley-Hamilton theorem that every matrix satisfies its characteristic 
equation. 


Georg Bernhard Riemann (1826—1866), in his 1854 inaugural lecture at the University 
of Gottingen entitled “On the Hypotheses which Lie at the Foundation of Geometry’, 
discussed the general notion of an n-dimensional manifold, developed the idea of a 
metric relation on such a manifold, and gave criteria which would determine whether 
a three-dimensional manifold is Euclidean, or “flat”. This lecture had enormous influ- 
ence on the development of geometry, including non-Euclidean geometry, as well as 
on the development of a new concept of our physical space ultimately necessary for the 
theory of general relativity. Among his other achievements, Riemann’s work on com- 
plex functions and their associated Riemann surfaces became one of the foundations of 
combinatorial topology. 


Richard Dedekind (1831—1916) solved the problem of the lack of unique factorization in 
rings of algebraic integers by introducing ideals and their arithmetic and demonstrat- 
ing that every ideal is either prime or can be expressed uniquely as a product of prime 
ideals. During his teaching at Zurich in the late 1850s, he realized that, although differ- 
ential calculus deals with continuous magnitudes, there was no satisfactory definition 
available of what it means for the set of real numbers to be continuous. He therefore 
worked out a definition of irrational numbers through his idea of what is now called 
a Dedekind cut in the set of rational numbers. Somewhat later Dedekind also consid- 
ered the basic ideas of set theory and gave a set theoretic characterization of the natural 
numbers. 


Sofia Kovalevskaya (1850—1891) was the first European woman since the Renaissance to 
earn a Ph.D. in mathematics (1874), a degree based on her many new results in the the- 
ory of partial differential equations. Because women were generally not permitted to 
study mathematics officially in European universities, Kovalevskaya had been forced 
to study privately with Weierstrass. Her mathematical talents eventually earned her a 
professorship at the University of Stockholm, an editorship of the journal Acta Math- 
ematica, and the Prix Bordin of the French Academy of Sciences for her work on the 
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revolution of a solid body about a fixed point. Unfortunately, her career was cut short 
by her untimely death from pneumonia at the age of 41. 


Henri Poincaré (1854-1912), one of the last of the universal mathematicians, contributed 
to virtually every area of mathematics, including physics and theoretical astronomy. 
Among his many contributions was the introduction of the idea of homology into topol- 
ogy, the creation of a model of Lobachevskian geometry which helped to convince 
mathematicians that this non-Euclidean geometry was as valid as Euclid’s, and a de- 
tailed study of the non-linear partial differential equations governing planetary motion 
aimed at answering questions about the stability of the solar system. Toward the end of 
his life, Poincaré wrote several popular books emphasizing the importance of science 
and mathematics. 


David Hilbert (7862-1943) is probably most famous for his lecture at the International 
Congress of Mathematicians in Paris in 1900 in which he presented a list of 23 problems 
which he felt would be of central importance for 20th century mathematics. Most of 
the problems have now been solved, while significant progress has been achieved in the 
remainder. Hilbert himself made notable contributions to the study of algebraic forms, 
algebraic number theory, the foundations of geometry, integral equations, theoretical 
physics, and the foundations of mathematics. 


Leonard Eugene Dickson (1874—1954) was the first recipient of a doctorate in mathematics 
at the University of Chicago, where he ultimately spent most of his mathematical ca- 
reer. Dickson helped to develop the abstract approach to algebra by developing sets of 
axioms for such constructs as groups, fields, and algebras. Among his important books 
was his monumental three volume History of the Theory of Numbers, which traced the 
evolution of every important concept in that field. 


Emmy Noether (1882-1935) received her doctorate from the University of Erlangen in 
1908, a few years later moving to Gottingen to assist Hilbert in the study of general 
relativity. During her 18 years there, she was extremely influential in stimulating a new 
style of thinking in algebra by always emphasizing its structural rather than computa- 
tional aspects. She is most famous for her work on what are now called Noetherian 
rings, but her inspiration of others is still evident in today’s textbooks in abstract alge- 
bra. 


Alan Turing (1912—1954) developed the concept of a “Turing machine” in 1936 to answer 
the questions of what a computation is and whether a given computation can in fact be 
carried out. This notion today lies at the basis of the modern all-purpose computer, a 
machine which can be programmed to do any desired computation. During World War 
II, Turing led the successful effort in England to crack the German “Enigma” code, an 
effort central to the defeat of Nazi Germany. 
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